00000001:02000400:0.0F:1782727551.940289:0:3098:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1782727569.613196:0:3319:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1782727571.249892:0:3382:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 839 MB/s 00000001:01000000:0.0:1782727571.499983:0:3382:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 807 MB/s 00000001:01000000:3.0:1782727571.749568:0:3382:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5655 MB/s 00000020:02000000:1.0F:1782727572.384493:0:3411:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_gbddb8b7 00000400:02000000:2.0F:1782727573.230506:0:3426:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.201.108@tcp [8/256/0/180] 00008000:02000000:0.0:1782727576.434957:0:3576:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1782727627.331101:0:5179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1782727641.003732:0:5928:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782727641.003739:0:5928:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1782727641.003740:0:5928:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1782727641.003899:0:5928:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000004e3b47d8 00000080:02000400:3.0:1782727641.003909:0:5928:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1782727641.026831:0:5928:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1782727641.026851:0:5928:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782727641.027112:0:5928:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000db2e2010) 00000020:00000080:1.0:1782727641.027133:0:5928:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782727641.071882:0:5928:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1782727641.072781:0:5928:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1782727641.091310:0:5928:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1782727641.092048:0:5928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1782727641.092060:0:5928:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782727641.092077:0:5928:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb393e873fab640ae 00000020:01000004:0.0:1782727641.092086:0:5928:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1782727641.092093:0:5928:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1782727641.092098:0:5928:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004e3b47d8 from MGS 00000020:01000004:0.0:1782727641.092103:0:5928:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1782727641.092127:0:5928:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000aeab1cd4) 00000020:00000080:0.0:1782727641.092136:0:5928:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1782727641.092268:0:5928:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004e3b47d8 from MGS, refs=2 00080000:01000000:0.0:1782727641.092274:0:5928:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782727641.092278:0:5928:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb393e873fab640bc 00000100:00100000:0.0:1782727641.092365:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1782727641.092504:0:5928:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1782727641.092510:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1782727641.096397:0:5928:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1782727641.096436:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1782727641.097775:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782727641.097999:0:5928:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1782727641.098007:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782727641.099033:0:5928:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782727641.099044:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1782727641.099687:0:5928:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1782727641.099694:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1782727641.100381:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727641.100384:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727641.100386:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727641.100873:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727641.100876:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727641.100877:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727641.101569:0:5928:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1782727641.106071:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1782727641.351926:0:5928:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3715 MB/s 00000001:01000000:1.0:1782727641.602382:0:5928:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3031 MB/s 00000001:01000000:3.0:1782727641.852312:0:5928:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 459 MB/s 00000001:01000000:0.0:1782727642.104570:0:5928:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 739 MB/s 00080000:10000000:0.0:1782727642.111903:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1782727642.129992:0:5928:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1782727642.134120:0:5942:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782727642.134180:0:5928:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782727642.134244:0:5928:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1782727642.134747:0:5928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782727642.134772:0:5928:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1782727642.135174:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727642.135329:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1782727642.135336:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782727642.136815:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782727642.136828:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1782727642.137853:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1782727642.137861:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1782727642.138702:0:5947:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1782727642.138851:0:5928:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1782727642.138875:0:5928:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.108@tcp' 00000020:01000004:2.0:1782727642.138877:0:5928:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1782727642.138930:0:5928:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.108@tcp (typ=mgc) 00000020:00000080:2.0:1782727642.138949:0:5928:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.108@tcp (000000004621436d) 00000020:00000080:2.0:1782727642.139041:0:5928:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1782727642.139183:0:5928:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000648735ef@MGC192.168.201.108@tcp: add connection 192.168.201.108@tcp at head 00010000:00010000:2.0:1782727642.139352:0:5928:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.108@tcp-0 is initialized 00000040:01000000:2.0:1782727642.139358:0:5928:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 1 is initialized 00010000:00010000:3.0:1782727642.139618:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782727642.145867:0:5948:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1782727642.145937:0:5928:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.108@tcp (uuid 5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73) 00000020:00000080:2.0:1782727642.145965:0:5928:0:(genops.c:1406:class_connect()) connect: client 5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73, cookie 0xb393e873fab640ca 00000100:00080000:2.0:1782727642.145979:0:5928:0:(import.c:512:import_select_connection()) MGC192.168.201.108@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782727642.145985:0:5928:0:(import.c:626:import_select_connection()) MGC192.168.201.108@tcp: import 00000000648735ef using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1782727642.146038:0:5928:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a5f08468 x1869325347586176/t0(0) o250->MGC192.168.201.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782727642.146118:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a5f08468 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3441:1869325347586176:0@lo:250: 00000100:00100000:2.0:1782727642.146213:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782727642.146277:0:5928:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73->MGS 00000020:01000004:2.0:1782727642.146292:0:5928:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1782727642.146315:0:5928:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1782727642.146330:0:5928:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000079abf6a9) 00000020:00000080:2.0:1782727642.146343:0:5928:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1782727642.150128:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347586176 00000100:00100000:3.0:1782727642.150143:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347586176 00000100:00100000:3.0:1782727642.150196:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727642.150203:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a7da115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3441:x1869325347586176:12345-0@lo:250: 00010000:00080000:3.0:1782727642.150231:0:5944:0:(ldlm_lib.c:1434:target_handle_connect()) MGS: connection from 5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:3.0:1782727642.150259:0:5944:0:(genops.c:1406:class_connect()) connect: client 5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73, cookie 0xb393e873fab640d8 00000100:00080000:3.0:1782727642.151205:0:5944:0:(import.c:65:import_set_state_nolock()) 00000000e030f740 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782727642.151289:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a7da115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+5:3441:x1869325347586176:12345-0@lo:250: Request processed in 1085us (5076us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727642.151297:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727642.152116:0:3441:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.108@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782727642.152128:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.108@tcp: connect to target with instance 0 00000100:00080000:3.0:1782727642.152136:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.108@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782727642.152142:0:3441:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782727642.152145:0:3441:0:(import.c:65:import_set_state_nolock()) 00000000648735ef MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782727642.152148:0:3441:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782727642.152161:0:3441:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782727642.152166:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a5f08468 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3441:1869325347586176:0@lo:250: 00000100:00100000:3.0:1782727642.180818:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727642.181091:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1782727642.181099:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1782727642.182056:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1782727642.182065:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1782727642.183013:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1782727642.183023:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1782727642.184363:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727642.184701:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1782727642.184707:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1782727642.185638:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1782727642.185646:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1782727642.233728:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727642.233935:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1782727642.233941:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1782727642.235115:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1782727642.235127:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782727642.235934:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727642.236120:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782727642.236125:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1782727642.236889:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782727642.236900:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1782727642.237654:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727642.237864:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782727642.237870:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1782727642.238380:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782727642.238386:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1782727642.239133:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727642.239378:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782727642.239384:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782727642.239960:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782727642.239967:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782727642.262794:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727642.263030:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782727642.263038:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1782727642.266136:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782727642.266156:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1782727642.268804:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782727642.268818:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1782727642.269619:0:5928:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1782727642.269653:0:5928:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1782727642.269660:0:5928:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1782727642.269770:0:5928:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782727642.269811:0:5928:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.108@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1782727642.269819:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782727642.269821:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727642.269823:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727642.269824:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727642.269825:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727642.269826:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727642.269827:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727642.269829:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727642.269830:0:5928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727642.269831:0:5928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727642.269833:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727642.269834:0:5928:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782727642.269836:0:5928:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1782727642.269838:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782727642.269839:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727642.269840:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727642.269841:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727642.269842:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727642.269843:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727642.269844:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727642.269845:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727642.269846:0:5928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727642.269847:0:5928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727642.269848:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727642.269848:0:5928:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782727642.269886:0:5928:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782727642.269906:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000583677d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586304:0@lo:253: 00000100:00100000:1.0:1782727642.270004:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.270121:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 000000006d8e50cd going to sleep for 11 seconds 00000100:00100000:0.0:1782727642.270230:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347586304 00000100:00100000:0.0:1782727642.270240:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347586304 00000100:00100000:0.0:1782727642.270414:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727642.270452:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073c091db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+5:5928:x1869325347586304:12345-0@lo:253: 20000000:01000000:0.0:1782727642.270513:0:5946:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782727642.270517:0:5946:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1782727642.270901:0:5967:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1782727642.270964:0:5946:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1782727642.271315:0:5946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727642.272667:0:5968:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1782727642.272858:0:5946:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782727642.272863:0:5946:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1782727642.272869:0:5946:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1782727642.272872:0:5946:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1782727642.272884:0:5946:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1782727642.273083:0:5946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727642.273382:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1782727642.273397:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782727642.273417:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1782727642.274022:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1782727642.274039:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1782727642.274115:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1782727642.274123:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1782727642.274136:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1782727642.274140:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1782727642.274150:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1782727642.274154:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1782727642.274166:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1782727642.274181:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1782727642.274206:0:5946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1782727642.274211:0:5946:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1782727642.274218:0:5946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727642.274645:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1782727642.274657:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782727642.274674:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1782727642.274689:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1782727642.274705:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1782727642.274715:0:5946:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1782727642.274746:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1782727642.274754:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782727642.274767:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1782727642.274795:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1782727642.274808:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1782727642.274817:0:5946:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1782727642.274837:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1782727642.274843:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1782727642.274854:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1782727642.274867:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1782727642.274933:0:5946:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1782727642.274954:0:5946:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1782727642.274962:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1782727642.275582:0:5969:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1782727642.275815:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1782727642.275840:0:5946:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.108@tcp for mdt 20000000:01000000:0.0:1782727642.275842:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:0.0:1782727642.275856:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1782727642.275861:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782727642.275872:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1782727642.275877:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:0.0:1782727642.275903:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1782727642.275912:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1782727642.275925:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1782727642.275940:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1782727642.275969:0:5946:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782727642.275974:0:5946:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782727642.275979:0:5946:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782727642.276041:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782727642.276043:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782727642.276580:0:5970:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1782727642.276744:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1782727642.276764:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1782727642.276776:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1782727642.276786:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782727642.276787:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782727642.277124:0:5971:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1782727642.277352:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1782727642.277373:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1782727642.277387:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1782727642.277397:0:5946:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727642.277399:0:5946:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1782727642.277403:0:5946:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782727642.277405:0:5946:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782727642.277411:0:5946:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1782727642.277418:0:5946:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1782727642.277957:0:5972:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1782727642.278086:0:5946:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1782727642.286419:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1782727642.286504:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1782727642.286522:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1782727642.286543:0:5946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782727642.286564:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.286582:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.286594:0:5946:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.286600:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.286606:0:5946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.286612:0:5946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.286634:0:5946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000044a38070 already unused, calling callback (0000000073e06647) 00010000:00010000:0.0:1782727642.286638:0:5946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.286644:0:5946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.286656:0:5946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.286662:0:5946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.286668:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044a38070/0xb393e873fab640df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782727642.286687:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1782727642.300560:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073c091db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+5:5928:x1869325347586304:12345-0@lo:253: Request processed in 30131us (30549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727642.300581:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727642.300679:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000583677d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586304:0@lo:253: 10000000:01000000:2.0:1782727642.300696:0:5928:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782727642.300699:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782727642.300701:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782727642.300702:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782727642.300703:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1782727642.300705:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782727642.300706:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782727642.300707:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782727642.300708:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782727642.300710:0:5928:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782727642.300711:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782727642.300713:0:5928:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782727642.300731:0:5928:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004e3b47d8 from lustre-MDT0000 10000000:01000000:2.0:1782727642.300763:0:5928:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1782727642.300767:0:5928:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1782727642.300772:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91fcf9dc33a0 10000000:01000000:2.0:1782727642.300777:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782727642.300784:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91fcf9dc33a0 from 1 10000000:01000000:2.0:1782727642.300787:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782727642.300825:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 000000003eb458a5/0xb393e873fab640e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.300838:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 000000003eb458a5/0xb393e873fab640e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.300847:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 000000003eb458a5/0xb393e873fab640e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727642.300866:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000921cdfcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586432:0@lo:101: 00000100:00100000:2.0:1782727642.300930:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727642.301023:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347586432 00000100:00100000:3.0:1782727642.301031:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347586432 00000100:00100000:2.0:1782727642.301049:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d7fe5fe6 going to sleep for 11 seconds 00000100:00100000:3.0:1782727642.304514:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727642.304538:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000116d6e05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+5:5928:x1869325347586432:12345-0@lo:101: 00010000:00010000:3.0:1782727642.304558:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727642.304582:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b7b36bba/0xb393e873fab640ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab640e6 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727642.304611:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b7b36bba/0xb393e873fab640ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab640e6 expref: 6 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727642.304622:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b7b36bba/0xb393e873fab640ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab640e6 expref: 6 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727642.304632:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b7b36bba, rc 0) 00000100:00100000:3.0:1782727642.304775:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000116d6e05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+6:5928:x1869325347586432:12345-0@lo:101: Request processed in 250us (3845us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727642.304783:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782727642.306779:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000921cdfcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586432:0@lo:101: 00010000:00010000:1.0:1782727642.306831:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 000000003eb458a5/0xb393e873fab640e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.306844:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 000000003eb458a5/0xb393e873fab640e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727642.307022:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c5d75eed pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586560:0@lo:501: 00000100:00100000:0.0:1782727642.307103:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727642.307183:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 0000000080bc6fac going to sleep for 11 seconds 00000100:00100000:1.0:1782727642.310749:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347586560 00000100:00100000:1.0:1782727642.310766:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347586560 00000100:00100000:1.0:1782727642.310831:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727642.310840:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ee66ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+6:5928:x1869325347586560:12345-0@lo:501: 00000100:00100000:1.0:1782727642.310985:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ee66ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+6:5928:x1869325347586560:12345-0@lo:501: Request processed in 147us (3882us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782727642.310993:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727642.311089:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c5d75eed pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586560:0@lo:501: 10000000:01000000:2.0:1782727642.311131:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782727642.311147:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 000000003eb458a5/0xb393e873fab640e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.311157:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 000000003eb458a5/0xb393e873fab640e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727642.311166:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91fcc90cc800 10000000:01000000:2.0:1782727642.311170:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782727642.311175:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91fcc90cc800 10000000:01000000:2.0:1782727642.311177:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1782727642.311180:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff91fcc90cc800 from 1 10000000:01000000:2.0:1782727642.311182:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1782727642.311210:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000f302336c/0xb393e873fab640f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.311218:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000f302336c/0xb393e873fab640f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.311226:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000f302336c/0xb393e873fab640f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727642.311243:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586688:0@lo:101: 00000100:00100000:2.0:1782727642.311288:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727642.311329:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 0000000041fb7deb going to sleep for 11 seconds 00000100:00100000:1.0:1782727642.311469:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347586688 00000100:00100000:1.0:1782727642.311474:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347586688 00000100:00100000:1.0:1782727642.311496:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727642.311503:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e098cb7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+6:5928:x1869325347586688:12345-0@lo:101: 00010000:00010000:1.0:1782727642.311511:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727642.311527:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001241dc9a/0xb393e873fab640fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab640f4 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.311549:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001241dc9a/0xb393e873fab640fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab640f4 expref: 7 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.311560:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001241dc9a/0xb393e873fab640fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab640f4 expref: 7 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.311570:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001241dc9a, rc 0) 00000100:00100000:1.0:1782727642.311597:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e098cb7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+7:5928:x1869325347586688:12345-0@lo:101: Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727642.311616:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727642.311696:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586688:0@lo:101: 00010000:00010000:2.0:1782727642.311714:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000f302336c/0xb393e873fab640f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab640fb expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.311722:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000f302336c/0xb393e873fab640f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab640fb expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727642.311734:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1782727642.311741:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 00000000f302336c/0xb393e873fab640f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab640fb expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.311748:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 00000000f302336c/0xb393e873fab640f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab640fb expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727642.311753:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1782727642.311756:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782727642.311760:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91fcc90cc800 10000000:01000000:2.0:1782727642.311763:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1782727642.311765:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1782727642.311767:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782727642.311780:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 0000000068f275aa/0xb393e873fab64102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.311786:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 0000000068f275aa/0xb393e873fab64102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.311792:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 0000000068f275aa/0xb393e873fab64102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727642.311803:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586816:0@lo:101: 00000100:00100000:2.0:1782727642.311825:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727642.311860:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 0000000041fb7deb going to sleep for 11 seconds 00000100:00100000:2.0:1782727642.311882:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347586816 00000100:00100000:2.0:1782727642.311885:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347586816 00000100:00100000:2.0:1782727642.311901:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727642.311905:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aee63633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+7:5928:x1869325347586816:12345-0@lo:101: 00010000:00010000:2.0:1782727642.311911:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727642.311917:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c612232/0xb393e873fab64109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64102 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.311929:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c612232/0xb393e873fab64109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64102 expref: 8 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.311935:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c612232/0xb393e873fab64109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64102 expref: 8 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.311941:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c612232, rc 0) 00000100:00100000:2.0:1782727642.311968:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aee63633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+8:5928:x1869325347586816:12345-0@lo:101: Request processed in 62us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727642.311973:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727642.311995:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586816:0@lo:101: 00010000:00010000:2.0:1782727642.312003:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 0000000068f275aa/0xb393e873fab64102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.312010:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 0000000068f275aa/0xb393e873fab64102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727642.312053:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586944:0@lo:501: 00000100:00100000:2.0:1782727642.312077:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727642.312085:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 0000000041fb7deb going to sleep for 11 seconds 00000100:00100000:2.0:1782727642.312108:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347586944 00000100:00100000:2.0:1782727642.312111:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347586944 00000100:00100000:2.0:1782727642.312128:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727642.312133:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dd44927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+8:5928:x1869325347586944:12345-0@lo:501: 00000100:00100000:2.0:1782727642.312234:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dd44927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:5928:x1869325347586944:12345-0@lo:501: Request processed in 101us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727642.312241:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727642.312393:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347586944:0@lo:501: 00000100:00100000:2.0:1782727642.312462:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587072:0@lo:503: 00000100:00100000:2.0:1782727642.312503:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727642.312514:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 0000000041fb7deb going to sleep for 11 seconds 00000100:00100000:2.0:1782727642.312533:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347587072 00000100:00100000:2.0:1782727642.312536:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347587072 00000100:00100000:2.0:1782727642.312554:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727642.312559:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044c30552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:5928:x1869325347587072:12345-0@lo:503: 00000100:00100000:2.0:1782727642.312644:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044c30552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:5928:x1869325347587072:12345-0@lo:503: Request processed in 85us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727642.312651:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727642.312682:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587072:0@lo:503: 00000100:00100000:2.0:1782727642.314690:0:5973:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5973:1869325347587200:0@lo:502: 00000100:00100000:2.0:1782727642.314770:0:5973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727642.314823:0:5973:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ae78f47e going to sleep for 11 seconds 00000100:00100000:1.0:1782727642.314881:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347587200 00000100:00100000:1.0:1782727642.314888:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347587200 00000100:00100000:1.0:1782727642.314973:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727642.314982:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082bc5794 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:5973:x1869325347587200:12345-0@lo:502: 00000100:00100000:1.0:1782727642.315099:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082bc5794 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:5973:x1869325347587200:12345-0@lo:502: Request processed in 119us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727642.315108:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727642.315191:0:5973:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5973:1869325347587200:0@lo:502: 00000020:01000000:2.0:1782727642.315217:0:5973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727642.315228:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727642.315231:0:5973:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1782727642.315242:0:5973:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1782727642.315244:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782727642.315271:0:5973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000020b3db3c) 00000020:00000080:2.0:1782727642.315289:0:5973:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1782727642.315294:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1782727642.315379:0:5973:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1782727642.315386:0:5973:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb393e873fab64117 00000020:00000080:2.0:1782727642.315714:0:5973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1782727642.315719:0:5973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727642.315723:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727642.315724:0:5973:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1782727642.315727:0:5973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727642.315731:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727642.315732:0:5973:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1782727642.315735:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782727642.315743:0:5973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000084b3ad08) 00000020:00000080:2.0:1782727642.315752:0:5973:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1782727642.315756:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1782727642.315757:0:5973:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1782727642.315760:0:5973:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1782727642.315766:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782727642.315820:0:5973:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004e3b47d8 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1782727642.315857:0:5973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e75611ad) 00000020:00000080:2.0:1782727642.315867:0:5973:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1782727642.315938:0:5973:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1782727642.315943:0:5973:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb393e873fab6412c 00000020:00000080:2.0:1782727642.316055:0:5973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1782727642.316061:0:5973:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1782727642.316065:0:5973:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb393e873fab64133 00080000:01000000:2.0:1782727642.316071:0:5973:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1782727642.316074:0:5973:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb393e873fab6413a 00080000:10000000:2.0:1782727642.316580:0:5973:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1782727642.316716:0:5973:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1782727642.331334:0:5973:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1782727642.448483:0:5973:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1782727642.449374:0:5973:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1782727642.453549:0:5973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1782727642.454100:0:5973:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1782727642.458169:0:5973:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000019dd67f6) 00000020:00000080:0.0:1782727642.458188:0:5973:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1782727642.458269:0:5973:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1782727642.458277:0:5973:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb393e873fab64148 00000020:00000080:2.0:1782727642.459212:0:5973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1782727642.460478:0:5973:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1782727642.468569:0:5973:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1782727642.474835:0:5973:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1782727642.478252:0:5973:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1782727642.481310:0:5973:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1782727642.501132:0:5973:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1782727642.514184:0:5973:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb393e873fab6414f 00000020:00000080:2.0:1782727642.517218:0:5973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1782727642.517235:0:5973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727642.517249:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727642.517252:0:5973:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1782727642.517255:0:5973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727642.517260:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727642.517261:0:5973:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782727642.517264:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782727642.517265:0:5973:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782727642.517268:0:5973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727642.517271:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727642.517272:0:5973:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782727642.517274:0:5973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727642.517279:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727642.517280:0:5973:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1782727642.517284:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1782727642.517344:0:5973:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1782727642.517412:0:5973:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5973:1869325347587328:0@lo:502: 00000100:00100000:2.0:1782727642.517562:0:5973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727642.517637:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347587328 00000100:00100000:2.0:1782727642.517641:0:5973:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ae78f47e going to sleep for 11 seconds 00000100:00100000:0.0:1782727642.517646:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347587328 00000100:00100000:0.0:1782727642.517692:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727642.517700:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044cf4faf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:5973:x1869325347587328:12345-0@lo:502: 00000100:00100000:0.0:1782727642.517816:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044cf4faf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:5973:x1869325347587328:12345-0@lo:502: Request processed in 117us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727642.517830:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782727642.522892:0:5973:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5973:1869325347587328:0@lo:502: 00000020:01000000:2.0:1782727642.523878:0:5973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727642.523895:0:5973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727642.523897:0:5973:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1782727642.523902:0:5973:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1782727642.525843:0:5928:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1782727642.525887:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782727642.525975:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 0000000068f275aa/0xb393e873fab64102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.525989:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 0000000068f275aa/0xb393e873fab64102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727642.525998:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91fcc90cc800 from 1 10000000:01000000:0.0:1782727642.526001:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782727642.526054:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.526062:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.526070:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727642.526095:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d84a4c44 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587456:0@lo:101: 00000100:00100000:0.0:1782727642.526600:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727642.526877:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 000000009b23d1ad going to sleep for 11 seconds 00000100:00100000:2.0:1782727642.527832:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347587456 00000100:00100000:2.0:1782727642.527858:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347587456 00000100:00100000:2.0:1782727642.527902:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782727642.527919:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1ddf5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:5928:x1869325347587456:12345-0@lo:101: 00010000:00010000:2.0:1782727642.527935:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727642.527953:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f39a4432/0xb393e873fab6415d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64156 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.527978:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f39a4432/0xb393e873fab6415d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64156 expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.527987:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f39a4432/0xb393e873fab6415d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64156 expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.527995:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f39a4432, rc 0) 00000100:00100000:2.0:1782727642.528064:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1ddf5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:5928:x1869325347587456:12345-0@lo:101: Request processed in 146us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727642.528071:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727642.528326:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d84a4c44 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587456:0@lo:101: 00010000:00010000:1.0:1782727642.528343:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.528351:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727642.529096:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587584:0@lo:256: 00000100:00100000:1.0:1782727642.529159:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.529213:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 0000000091604598 going to sleep for 11 seconds 00000100:00100000:0.0:1782727642.529298:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347587584 00000100:00100000:0.0:1782727642.529305:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347587584 00000100:00100000:0.0:1782727642.529340:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727642.529347:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3241c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:5928:x1869325347587584:12345-0@lo:256: 20000000:01000000:0.0:1782727642.529364:0:5944:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1782727642.529370:0:5944:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1782727642.529514:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3241c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:5928:x1869325347587584:12345-0@lo:256: Request processed in 167us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727642.529521:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727642.530816:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587584:0@lo:256: 10000000:01000000:1.0:1782727642.531767:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782727642.531835:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.531873:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727642.531882:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91fcc90cc800 from 1 10000000:01000000:1.0:1782727642.531885:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727642.531946:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.531955:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.531967:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727642.531991:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587712:0@lo:101: 00000100:00100000:1.0:1782727642.532060:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.532112:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 0000000091604598 going to sleep for 11 seconds 00000100:00100000:0.0:1782727642.534839:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347587712 00000100:00100000:0.0:1782727642.534858:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347587712 00000100:00100000:0.0:1782727642.534933:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727642.534942:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b39ea59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:5928:x1869325347587712:12345-0@lo:101: 00010000:00010000:0.0:1782727642.534963:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727642.534984:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c2c1002e/0xb393e873fab6416b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64164 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.535016:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2c1002e/0xb393e873fab6416b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64164 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.535027:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c2c1002e/0xb393e873fab6416b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64164 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.535038:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c2c1002e, rc 0) 00000100:00100000:0.0:1782727642.535134:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b39ea59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5928:x1869325347587712:12345-0@lo:101: Request processed in 192us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727642.535141:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727642.535930:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587712:0@lo:101: 00010000:00010000:1.0:1782727642.535949:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.535959:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727642.536059:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587840:0@lo:501: 00000100:00100000:1.0:1782727642.536211:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.536254:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 0000000091604598 going to sleep for 11 seconds 00000100:00100000:1.0:1782727642.536279:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347587840 00000100:00100000:1.0:1782727642.536284:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347587840 00000100:00100000:1.0:1782727642.536321:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727642.536327:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0c32fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5928:x1869325347587840:12345-0@lo:501: 00000100:00100000:1.0:1782727642.536525:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0c32fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5928:x1869325347587840:12345-0@lo:501: Request processed in 198us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727642.536532:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727642.537165:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587840:0@lo:501: 00000100:00100000:1.0:1782727642.537208:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587968:0@lo:503: 00000100:00100000:1.0:1782727642.537253:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.537289:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 0000000091604598 going to sleep for 11 seconds 00000100:00100000:0.0:1782727642.537802:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347587968 00000100:00100000:0.0:1782727642.537810:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347587968 00000100:00100000:0.0:1782727642.537857:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727642.537864:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008acd34d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5928:x1869325347587968:12345-0@lo:503: 00000040:00080000:0.0:1782727642.537903:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782727642.538076:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008acd34d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5928:x1869325347587968:12345-0@lo:503: Request processed in 213us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727642.538083:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727642.538361:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347587968:0@lo:503: 00000040:00080000:1.0:1782727642.539060:0:5977:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1782727642.539139:0:5928:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1782727642.539161:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727642.539935:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.539949:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727642.540006:0:5928:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782727642.540009:0:5928:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91fcc90cc800 10000000:01000000:1.0:1782727642.540013:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91fcc90cc800 10000000:01000000:1.0:1782727642.540017:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727642.540023:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91fcc90cc800 from 1 10000000:01000000:1.0:1782727642.540027:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727642.540060:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 000000001d3e317e/0xb393e873fab64172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.540078:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 000000001d3e317e/0xb393e873fab64172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.540088:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 000000001d3e317e/0xb393e873fab64172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727642.541752:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347588096:0@lo:101: 00000100:00100000:1.0:1782727642.541829:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.541885:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e8112a92 going to sleep for 11 seconds 00000100:00100000:0.0:1782727642.541956:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347588096 00000100:00100000:0.0:1782727642.541964:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347588096 00000100:00100000:0.0:1782727642.542014:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727642.542023:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009095c623 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5928:x1869325347588096:12345-0@lo:101: 00010000:00010000:0.0:1782727642.542036:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727642.542052:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000018b41701/0xb393e873fab64179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64172 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.542075:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000018b41701/0xb393e873fab64179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64172 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.542083:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000018b41701/0xb393e873fab64179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64172 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.542090:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000018b41701, rc 0) 00000100:00100000:0.0:1782727642.542155:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009095c623 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5928:x1869325347588096:12345-0@lo:101: Request processed in 133us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727642.542162:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782727642.542383:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347588096:0@lo:101: 00010000:00010000:1.0:1782727642.542402:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 000000001d3e317e/0xb393e873fab64172 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.542412:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 000000001d3e317e/0xb393e873fab64172 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727642.542520:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347588224:0@lo:501: 00000100:00100000:1.0:1782727642.542558:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.542574:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e8112a92 going to sleep for 11 seconds 00000100:00100000:0.0:1782727642.543113:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347588224 00000100:00100000:0.0:1782727642.543120:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347588224 00000100:00100000:0.0:1782727642.543163:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727642.543170:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000773c7794 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5928:x1869325347588224:12345-0@lo:501: 00000100:00100000:0.0:1782727642.543302:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000773c7794 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5928:x1869325347588224:12345-0@lo:501: Request processed in 132us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727642.543309:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782727642.543589:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347588224:0@lo:501: 00000100:00100000:1.0:1782727642.543621:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347588352:0@lo:503: 00000100:00100000:1.0:1782727642.543662:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.543687:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e8112a92 going to sleep for 11 seconds 00000100:00100000:3.0:1782727642.543788:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347588352 00000100:00100000:3.0:1782727642.543793:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347588352 00000100:00100000:3.0:1782727642.543821:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782727642.543827:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034813c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5928:x1869325347588352:12345-0@lo:503: 00000100:00100000:3.0:1782727642.543921:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034813c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5928:x1869325347588352:12345-0@lo:503: Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727642.543936:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782727642.544054:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347588352:0@lo:503: 00000100:00100000:1.0:1782727642.544412:0:5978:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5978:1869325347588480:0@lo:502: 00000100:00100000:1.0:1782727642.544492:0:5978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.544509:0:5978:0:(client.c:2701:ptlrpc_set_wait()) set 00000000af8cb270 going to sleep for 11 seconds 00000100:00100000:3.0:1782727642.544558:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347588480 00000100:00100000:3.0:1782727642.544563:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347588480 00000100:00100000:3.0:1782727642.544599:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782727642.544605:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a1737bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5978:x1869325347588480:12345-0@lo:502: 00000100:00100000:3.0:1782727642.544684:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a1737bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5978:x1869325347588480:12345-0@lo:502: Request processed in 79us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727642.544691:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727642.544820:0:5978:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5978:1869325347588480:0@lo:502: 00000020:01000004:1.0:1782727642.544872:0:5978:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782727642.544886:0:5978:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000048436ebb) 00000020:00000080:1.0:1782727642.544903:0:5978:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1782727642.545089:0:5978:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004e3b47d8 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782727642.545094:0:5978:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004e3b47d8 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782727642.545096:0:5978:0:(obd_mount.c:701:lustre_put_lsi()) put 000000004e3b47d8 4 00010000:00080000:1.0:1782727642.545123:0:5978:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b620399e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:1.0:1782727642.552327:0:5978:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1782727642.552487:0:5978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782727642.552529:0:5978:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782727642.552541:0:5978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb393e873fab64187 00000100:00080000:1.0:1782727642.552552:0:5978:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782727642.552556:0:5978:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b620399e using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1782727642.552766:0:5978:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e596dc28 x1869325347588608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782727642.552797:0:5978:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782727642.553017:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3441:1869325347588608:0@lo:38: 00000100:00100000:3.0:1782727642.553125:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727642.553256:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347588608 00000100:00100000:0.0:1782727642.553265:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347588608 00000100:00100000:0.0:1782727642.553312:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727642.553319:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d21c875 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3441:x1869325347588608:12345-0@lo:38: 00000100:00100000:0.0:1782727642.553390:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d21c875 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3441:x1869325347588608:12345-0@lo:38: Request processed in 69us (265us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782727642.553398:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727642.553467:0:3441:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782727642.553475:0:3441:0:(import.c:65:import_set_state_nolock()) 00000000b620399e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782727642.553481:0:3441:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782727642.553485:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e596dc28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3441:1869325347588608:0@lo:38: 00000100:00100000:1.0:1782727642.553890:0:5978:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c1283688 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5978:1869325347588736:0@lo:502: 00000100:00100000:1.0:1782727642.553946:0:5978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.553981:0:5978:0:(client.c:2701:ptlrpc_set_wait()) set 00000000af8cb270 going to sleep for 11 seconds 00000100:00100000:3.0:1782727642.554099:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347588736 00000100:00100000:3.0:1782727642.554105:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347588736 00000100:00100000:3.0:1782727642.554153:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727642.554161:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f2fa6e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5978:x1869325347588736:12345-0@lo:502: 00000100:00100000:3.0:1782727642.554270:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f2fa6e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5978:x1869325347588736:12345-0@lo:502: Request processed in 109us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727642.554277:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782727642.554883:0:5978:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c1283688 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5978:1869325347588736:0@lo:502: 00000040:00080000:1.0:1782727642.554929:0:5978:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1782727642.555744:0:5928:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1782727642.555774:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727642.555797:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 000000001d3e317e/0xb393e873fab64172 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727642.555815:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 000000001d3e317e/0xb393e873fab64172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782727642.555871:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782727642.555874:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727642.555875:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727642.555876:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727642.555878:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727642.555879:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727642.555880:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727642.555882:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727642.555883:0:5928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727642.555884:0:5928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727642.555886:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727642.555887:0:5928:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782727642.555891:0:5928:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1782727642.555894:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782727642.555896:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727642.555897:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727642.555898:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727642.555899:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727642.555900:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727642.555901:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727642.555902:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727642.555903:0:5928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727642.555904:0:5928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727642.555905:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727642.555906:0:5928:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782727642.555942:0:5928:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782727642.555958:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c1283688 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347588864:0@lo:253: 00000100:00100000:1.0:1782727642.556016:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727642.556058:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b5fc1522 going to sleep for 11 seconds 00000100:00100000:0.0:1782727642.556266:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347588864 00000100:00100000:0.0:1782727642.556274:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347588864 00000100:00100000:0.0:1782727642.556322:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727642.556330:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f73c1ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5928:x1869325347588864:12345-0@lo:253: 20000000:01000000:0.0:1782727642.556359:0:5946:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782727642.556373:0:5946:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782727642.569337:0:5946:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782727642.569357:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1782727642.569880:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f73c1ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5928:x1869325347588864:12345-0@lo:253: Request processed in 13547us (13859us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727642.569893:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782727642.570046:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c1283688 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5928:1869325347588864:0@lo:253: 10000000:01000000:1.0:1782727642.570061:0:5928:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782727642.570075:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782727642.570077:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727642.570078:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727642.570079:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727642.570081:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727642.570082:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727642.570083:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727642.570085:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727642.570086:0:5928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727642.570087:0:5928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727642.570089:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727642.570090:0:5928:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782727642.570106:0:5928:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1782727642.574162:0:5967:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782727642.574176:0:5967:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782727642.574202:0:5967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.574221:0:5967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f39a4432/0xb393e873fab6415d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64156 expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.574230:0:5967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.574268:0:5967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f39a4432/0xb393e873fab6415d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64156 expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.574282:0:5967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f39a4432/0xb393e873fab6415d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64156 expref: 11 pid: 5946 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727642.574309:0:5967:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007327764c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5967:1869325347588992:0@lo:104: 00000100:00100000:0.0:1782727642.574376:0:5967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727642.574469:0:5967:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a4d483a5 going to sleep for 11 seconds 00000100:00100000:2.0:1782727642.574825:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347588992 00000100:00100000:2.0:1782727642.574833:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347588992 00000100:00100000:2.0:1782727642.574883:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727642.574892:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bfa88a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5967:x1869325347588992:12345-0@lo:104: 00010000:00010000:2.0:1782727642.574917:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.574987:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727642.574992:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bfa88a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5967:x1869325347588992:12345-0@lo:104: Request processed in 102us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727642.574999:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1782727642.575022:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727642.575033:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.575040:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000044a38070 already unused, calling callback (000000002193ce47) 10000000:00010000:2.0:1782727642.575043:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.575050:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727642.575055:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727642.575060:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727642.575087:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.575093:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727642.575106:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.575112:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: 0000000044a38070/0xb393e873fab64156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6415d expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.575127:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727642.575129:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727642.575130:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727642.575311:0:5967:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007327764c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5967:1869325347588992:0@lo:104: 00010000:00010000:0.0:1782727642.575330:0:5967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727642.575390:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727642.575399:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347589120:0@lo:103: 00000100:00100000:0.0:1782727642.575470:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727642.576391:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347589120 00000100:00100000:2.0:1782727642.576402:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347589120 00010000:00010000:2.0:1782727642.576450:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f39a4432/0xb393e873fab6415d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64156 expref: 12 pid: 5946 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727642.576494:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727642.576501:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007327764c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:3442:x1869325347589120:12345-0@lo:103: 00010000:00010000:2.0:1782727642.576514:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727642.576518:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f39a4432/0xb393e873fab6415d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64156 expref: 12 pid: 5946 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576528:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f39a4432/0xb393e873fab6415d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64156 expref: 12 pid: 5946 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576543:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f39a4432/0xb393e873fab6415d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64156 expref: 12 pid: 5946 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576557:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576564:0:5936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782727642.576693:0:5936:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002519085s 00010000:00010000:2.0:1782727642.576698:0:5936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576705:0:5936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576711:0:5936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576717:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576733:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f8587211 already unused, calling callback (0000000073e06647) 00010000:00010000:2.0:1782727642.576736:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576743:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576761:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727642.576771:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727642.576827:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007327764c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:3442:x1869325347589120:12345-0@lo:103: Request processed in 327us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727642.576834:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727642.576873:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ecb5058f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347589120:0@lo:103: 00010000:00010000:0.0:1782727642.577040:0:5967:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.577047:0:5967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727642.577052:0:5967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f8587211/0xb393e873fab6418e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1782727642.578189:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1782727642.578369:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1782727642.578791:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1782727642.579097:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1782727642.579307:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1782727642.581100:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1782727642.582237:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1782727642.582412:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1782727642.582886:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1782727642.583220:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1782727642.583716:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1782727642.584072:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1782727642.592415:0:5928:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1782727642.603093:0:5928:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1782727642.603445:0:5984:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782727642.605194:0:5928:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1782727642.605324:0:5928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1782727642.606314:0:5928:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1782727642.606326:0:5928:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1782727642.606520:0:5928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1782727642.607531:0:5983:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1782727642.607537:0:5983:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1782727642.610360:0:5928:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1782727642.612517:0:5928:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1782727642.613838:0:5928:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1782727642.616326:0:5928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1782727642.619317:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1782727642.620221:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1782727642.620371:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1782727642.620573:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1782727642.620759:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1782727642.620914:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1782727642.621062:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1782727642.621228:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1782727642.621370:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1782727642.622117:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1782727642.622255:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1782727642.629091:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1782727642.629539:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1782727642.629798:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1782727642.630117:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1782727642.630286:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1782727642.630467:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1782727642.631215:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1782727642.631382:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000040:00080000:1.0:1782727642.631602:0:5984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1782727642.632162:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1782727642.635808:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1782727642.636063:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1782727642.636220:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1782727642.636410:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1782727642.636823:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1782727642.637315:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1782727642.637731:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1782727642.638105:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1782727642.638270:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1782727642.638411:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1782727642.639141:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1782727642.639315:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1782727642.639490:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1782727642.639858:0:5928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1782727642.647332:0:5984:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782727642.647730:0:5984:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782727642.647736:0:5984:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1782727642.650633:0:5928:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782727642.650669:0:5928:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa2f281943988 00100000:10000000:3.0:1782727642.650678:0:5928:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1782727642.651530:0:5928:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782727642.651547:0:5928:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782727642.651696:0:5928:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1782727642.651725:0:5928:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1782727642.652772:0:5928:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727642.654178:0:5928:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1782727643.164941:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727644.187595:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727645.214658:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727646.236239:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727647.260647:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782727647.707615:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1782727647.707625:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782727647.707628:0:37:0:(import.c:65:import_set_state_nolock()) 00000000b620399e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782727647.707641:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b620399e using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1782727647.707663:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002b11b34e x1869325347589376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782727647.707726:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002b11b34e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3441:1869325347589376:0@lo:38: 00000100:00100000:0.0:1782727647.707791:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727647.707869:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347589376 00000100:00100000:0.0:1782727647.707876:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347589376 00000100:00100000:0.0:1782727647.707905:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727647.707910:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000759888bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3441:x1869325347589376:12345-0@lo:38: 00010000:00080000:0.0:1782727647.707935:0:5953:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:0.0:1782727647.707972:0:5953:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb393e873fab64195 00000004:00100000:0.0:1782727647.708067:0:5953:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782727647.708213:0:5953:0:(import.c:65:import_set_state_nolock()) 0000000013633efd : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727647.708266:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000759888bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1869325347589376:12345-0@lo:38: Request processed in 354us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727647.708273:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782727647.708313:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002b11b34e x1869325347589376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782727647.708327:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782727647.708343:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782727647.708347:0:3441:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782727647.708349:0:3441:0:(import.c:65:import_set_state_nolock()) 00000000b620399e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782727647.708354:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002b11b34e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3441:1869325347589376:0@lo:38: 00000100:00100000:3.0:1782727647.708499:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a5f6ddb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347589248:0@lo:400: 00000100:00100000:3.0:1782727647.708534:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727647.708948:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347589248 00000100:00100000:0.0:1782727647.708954:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347589248 00000100:00100000:0.0:1782727647.708993:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782727647.709000:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6f8a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:3444:x1869325347589248:12345-0@lo:400: 00000100:00100000:0.0:1782727647.709039:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6f8a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:3444:x1869325347589248:12345-0@lo:400: Request processed in 40us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727647.709052:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727647.709153:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a5f6ddb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347589248:0@lo:400: 10000000:01000000:0.0:1782727647.713241:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782727647.713249:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91fcc90cc800 from 3 10000000:01000000:0.0:1782727647.713253:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782727647.713297:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 0000000045ab5983/0xb393e873fab6419c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727647.713309:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 0000000045ab5983/0xb393e873fab6419c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727647.713319:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 0000000045ab5983/0xb393e873fab6419c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727647.713369:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002b11b34e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347589504:0@lo:101: 00000100:00100000:0.0:1782727647.715587:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727647.716418:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set 00000000be626874 going to sleep for 11 seconds 00000100:00100000:3.0:1782727647.728862:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347589504 00000100:00100000:3.0:1782727647.728881:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347589504 00000100:00100000:3.0:1782727647.728987:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727647.728996:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027635460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5948:x1869325347589504:12345-0@lo:101: 00010000:00010000:3.0:1782727647.729016:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727647.729038:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b4a1f7c6/0xb393e873fab641a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab6419c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727647.729075:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4a1f7c6/0xb393e873fab641a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab6419c expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727647.729100:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b4a1f7c6/0xb393e873fab641a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab6419c expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727647.729109:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b4a1f7c6, rc 0) 00000100:00100000:3.0:1782727647.729211:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027635460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347589504:12345-0@lo:101: Request processed in 216us (13631us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727647.729218:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727647.729264:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002b11b34e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347589504:0@lo:101: 00010000:00010000:3.0:1782727647.729282:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 0000000045ab5983/0xb393e873fab6419c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727647.729291:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 0000000045ab5983/0xb393e873fab6419c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727647.729361:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000de59f72a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347589632:0@lo:256: 00000100:00100000:3.0:1782727647.730387:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727647.730459:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set 000000004bbbcdf2 going to sleep for 11 seconds 00000100:00100000:3.0:1782727647.730478:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347589632 00000100:00100000:3.0:1782727647.730483:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347589632 00000100:00100000:3.0:1782727647.730567:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727647.730576:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d76b479 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347589632:12345-0@lo:256: 20000000:01000000:3.0:1782727647.730594:0:5944:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782727647.730608:0:5944:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782727647.730611:0:5944:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1782727647.730713:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d76b479 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347589632:12345-0@lo:256: Request processed in 139us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727647.730720:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727647.730765:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000de59f72a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347589632:0@lo:256: 10000000:01000000:3.0:1782727647.730808:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782727647.730817:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 0000000045ab5983/0xb393e873fab6419c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727647.730826:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 0000000045ab5983/0xb393e873fab6419c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1782727647.795200:0:6229:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782727648.283737:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727648.912790:0:6281:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727648.912977:0:6281:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727649.308784:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727650.332995:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727651.356083:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727651.872252:0:6383:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727651.873187:0:6383:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727652.379717:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727652.827694:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000038c5438 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347589760:0@lo:400: 00000100:00100000:3.0:1782727652.827773:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727652.827886:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347589760 00000100:00100000:2.0:1782727652.827897:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347589760 00000100:00100000:2.0:1782727652.827970:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727652.827978:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d14407f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:3445:x1869325347589760:12345-0@lo:400: 00000100:00100000:2.0:1782727652.831555:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d14407f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:3445:x1869325347589760:12345-0@lo:400: Request processed in 3567us (3772us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727652.831574:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727652.831639:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000263735d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347589888:0@lo:400: 00000100:00100000:3.0:1782727652.831700:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000038c5438 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347589760:0@lo:400: 00000100:00100000:2.0:1782727652.831709:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727652.831753:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347589888 00000100:00100000:3.0:1782727652.831759:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347589888 00000100:00100000:3.0:1782727652.831802:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727652.831811:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb5058f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347589888:12345-0@lo:400: 00000100:00100000:3.0:1782727652.831868:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb5058f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347589888:12345-0@lo:400: Request processed in 59us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727652.831873:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782727652.831914:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000263735d9 x1869325347589888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727652.831940:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000263735d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347589888:0@lo:400: 00000020:00000080:0.0:1782727652.864163:0:6431:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffaf6a8af0 20000000:00000080:0.0:1782727652.864182:0:6431:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91fcf39e9800 uarg=0000000000000000 20000000:01000000:0.0:1782727652.864222:0:6431:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1782727652.864228:0:6431:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1782727652.864231:0:6431:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1782727652.864311:0:6431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1782727652.864593:0:6431:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1782727652.873455:0:6431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727652.873717:0:6431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1782727652.873752:0:6431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1782727652.873768:0:6431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1782727652.873783:0:6431:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782727652.873806:0:6431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727652.873827:0:6431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c2c1002e/0xb393e873fab6416b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64164 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727652.873836:0:6431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727652.873877:0:6431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c2c1002e/0xb393e873fab6416b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64164 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727652.873891:0:6431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c2c1002e/0xb393e873fab6416b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64164 expref: 11 pid: 5945 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727652.873909:0:6431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7cced05 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6431:1869325347590016:0@lo:104: 00000100:00100000:0.0:1782727652.873986:0:6431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727652.874047:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347590016 00000100:00100000:0.0:1782727652.874049:0:6431:0:(client.c:2701:ptlrpc_set_wait()) set 00000000146bfa42 going to sleep for 11 seconds 00000100:00100000:3.0:1782727652.874059:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347590016 00000100:00100000:3.0:1782727652.874127:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727652.874135:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d5e8264 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:6431:x1869325347590016:12345-0@lo:104: 00010000:00010000:3.0:1782727652.874147:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727652.874210:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727652.874215:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d5e8264 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:6431:x1869325347590016:12345-0@lo:104: Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727652.874222:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782727652.874391:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727652.874396:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874404:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009db655a8 already unused, calling callback (000000002193ce47) 10000000:00010000:1.0:1782727652.874406:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874417:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727652.874439:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727652.874446:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727652.874484:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874491:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727652.874527:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874534:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: 000000009db655a8/0xb393e873fab64164 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6416b expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874550:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727652.874551:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727652.874553:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727652.874560:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727652.874576:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c1283688 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347590144:0@lo:103: 00000100:00100000:1.0:1782727652.874606:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727652.874644:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347590144 00000100:00100000:1.0:1782727652.874647:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347590144 00000100:00100000:0.0:1782727652.874655:0:6431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7cced05 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6431:1869325347590016:0@lo:104: 00010000:00010000:1.0:1782727652.874662:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c2c1002e/0xb393e873fab6416b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64164 expref: 12 pid: 5945 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727652.874673:0:6431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727652.874678:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727652.874682:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a961a797 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:3442:x1869325347590144:12345-0@lo:103: 00010000:00010000:1.0:1782727652.874691:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727652.874695:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c2c1002e/0xb393e873fab6416b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64164 expref: 12 pid: 5945 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874703:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c2c1002e/0xb393e873fab6416b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64164 expref: 12 pid: 5945 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874713:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c2c1002e/0xb393e873fab6416b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64164 expref: 12 pid: 5945 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874725:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874731:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874744:0:5937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874750:0:5937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874755:0:5937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874765:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874771:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea3e06d5 already unused, calling callback (0000000073e06647) 00010000:00010000:1.0:1782727652.874773:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874779:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874798:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727652.874806:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727652.874841:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a961a797 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:3442:x1869325347590144:12345-0@lo:103: Request processed in 158us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727652.874848:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727652.874878:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c1283688 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347590144:0@lo:103: 00010000:00010000:0.0:1782727652.874937:0:6431:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727652.874944:0:6431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727652.874949:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea3e06d5/0xb393e873fab641aa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727653.403816:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727654.428067:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727655.461532:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727656.475842:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727657.499706:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782727657.948185:0:5948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782727657.948196:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91fcc90cc800 from 1 10000000:01000000:3.0:1782727657.948202:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727657.948267:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 000000005cebd277/0xb393e873fab641b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727657.948282:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 000000005cebd277/0xb393e873fab641b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727657.948306:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 000000005cebd277/0xb393e873fab641b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727657.948332:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000de59f72a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347590272:0@lo:101: 00000100:00100000:3.0:1782727657.948440:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727657.948504:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set 000000000486150e going to sleep for 11 seconds 00000100:00100000:1.0:1782727657.949141:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347590272 00000100:00100000:1.0:1782727657.949153:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347590272 00000100:00100000:1.0:1782727657.949498:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727657.949509:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000650ebaba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5948:x1869325347590272:12345-0@lo:101: 00010000:00010000:1.0:1782727657.949528:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727657.949550:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b97075d0/0xb393e873fab641b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab641b1 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727657.949580:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b97075d0/0xb393e873fab641b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab641b1 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727657.949601:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b97075d0/0xb393e873fab641b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab641b1 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727657.949611:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b97075d0, rc 0) 00000100:00100000:1.0:1782727657.949689:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000650ebaba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347590272:12345-0@lo:101: Request processed in 182us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727657.949697:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727657.949924:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7cced05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347590400:0@lo:400: 00000100:00100000:0.0:1782727657.949980:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727657.950051:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347590400 00000100:00100000:0.0:1782727657.950056:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347590400 00000100:00100000:0.0:1782727657.950085:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727657.950091:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010e68357 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347590400:12345-0@lo:400: 00000100:00100000:0.0:1782727657.950129:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010e68357 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347590400:12345-0@lo:400: Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727657.950135:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782727657.950619:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c7cced05 x1869325347590400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727657.950634:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7cced05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347590400:0@lo:400: 00000100:00100000:0.0:1782727657.952555:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000de59f72a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347590272:0@lo:101: 00010000:00010000:0.0:1782727657.952586:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 000000005cebd277/0xb393e873fab641b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727657.952597:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 000000005cebd277/0xb393e873fab641b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727657.952681:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7cced05 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347590528:0@lo:501: 00000100:00100000:0.0:1782727657.952743:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727657.959958:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cdb84cab going to sleep for 11 seconds 00000100:00100000:3.0:1782727657.960105:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347590528 00000100:00100000:3.0:1782727657.960119:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347590528 00000100:00100000:3.0:1782727657.960199:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782727657.960210:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d22a452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347590528:12345-0@lo:501: 00000100:00100000:3.0:1782727657.960510:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d22a452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347590528:12345-0@lo:501: Request processed in 302us (7767us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727657.960526:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782727657.964659:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7cced05 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347590528:0@lo:501: 00000100:00100000:2.0:1782727657.964766:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000524cd5ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347590656:0@lo:503: 00000100:00100000:2.0:1782727657.964898:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727657.965685:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set 0000000056439526 going to sleep for 11 seconds 00000100:00100000:0.0:1782727657.966066:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347590656 00000100:00100000:0.0:1782727657.966078:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347590656 00000100:00100000:3.0:1782727657.971909:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782727657.972074:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007433c2eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347590656:12345-0@lo:503: 00000100:00100000:3.0:1782727657.972501:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007433c2eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347590656:12345-0@lo:503: Request processed in 576us (7603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727657.972510:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782727657.978133:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000524cd5ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347590656:0@lo:503: 00000100:00100000:2.0:1782727657.984586:0:6595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000524cd5ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6595:1869325347590784:0@lo:502: 00000100:00100000:2.0:1782727657.984712:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727657.984782:0:6595:0:(client.c:2701:ptlrpc_set_wait()) set 0000000027e90286 going to sleep for 11 seconds 00000100:00100000:0.0:1782727657.985341:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347590784 00000100:00100000:0.0:1782727657.985363:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347590784 00000100:00100000:0.0:1782727657.985459:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782727657.985468:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008265c19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6595:x1869325347590784:12345-0@lo:502: 00000100:00100000:0.0:1782727657.985610:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008265c19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6595:x1869325347590784:12345-0@lo:502: Request processed in 143us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727657.985618:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782727657.994503:0:6595:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000524cd5ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6595:1869325347590784:0@lo:502: 00000020:01000000:2.0:1782727657.994590:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727657.994615:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727657.994618:0:6595:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782727657.994626:0:6595:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91fcc90cc800 00000020:00000080:2.0:1782727657.994629:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782727657.994725:0:6595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6595:1869325347590912:0@lo:502: 00000100:00100000:2.0:1782727657.994825:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727657.994882:0:6595:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0e710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727657.995235:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347590912 00000100:00100000:0.0:1782727657.995244:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347590912 00000100:00100000:0.0:1782727657.995317:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782727657.995328:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6595:x1869325347590912:12345-0@lo:502: 00000100:00100000:0.0:1782727657.995497:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6595:x1869325347590912:12345-0@lo:502: Request processed in 170us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727657.995506:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782727657.998337:0:6595:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6595:1869325347590912:0@lo:502: 00000020:01000000:2.0:1782727657.998401:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727657.998411:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727657.998415:0:6595:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782727658.003107:0:6595:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1782727658.004301:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782727658.004415:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727658.004453:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346cc00/0xb393e873fab641b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727658.004469:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcd346cc00/0xb393e873fab641b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727658.527486:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727659.547846:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727660.578902:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727661.595753:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727662.622963:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727663.068218:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727663.068250:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347591040:0@lo:400: 00000100:00100000:3.0:1782727663.068362:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727663.068474:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347591168:0@lo:400: 00000100:00100000:3.0:1782727663.068505:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727663.068546:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347591168 00000100:00100000:3.0:1782727663.068554:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347591168 00000100:00100000:3.0:1782727663.068609:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727663.068619:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347591168:12345-0@lo:400: 00000100:00100000:3.0:1782727663.068680:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347591168:12345-0@lo:400: Request processed in 62us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727663.068688:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782727663.068731:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91fcf3a64a80 x1869325347591168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727663.068744:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347591168:0@lo:400: 00000100:00100000:0.0:1782727663.069833:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347591040 00000100:00100000:0.0:1782727663.069843:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347591040 00000100:00100000:0.0:1782727663.069897:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727663.069906:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:3444:x1869325347591040:12345-0@lo:400: 00000100:00100000:0.0:1782727663.069976:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:3444:x1869325347591040:12345-0@lo:400: Request processed in 72us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727663.069983:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782727663.070114:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347591040:0@lo:400: 00010000:00010000:1.0:1782727663.650183:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782727664.645812:0:6931:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782727664.645815:0:6931:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1782727664.645817:0:6931:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1782727664.645964:0:6931:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91fcf9d2c000 00000020:01000004:0.0:1782727664.645978:0:6931:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1782727664.645988:0:6931:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1782727664.646001:0:6931:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91fcf9d98000) 00000020:00000080:0.0:1782727664.646014:0:6931:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1782727664.668650:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1782727664.695740:0:6931:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1782727664.695829:0:6931:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1782727664.769068:0:6931:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1782727664.769305:0:6931:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1782727664.769317:0:6931:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782727664.769329:0:6931:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb393e873fab641c6 00000020:01000004:1.0:1782727664.769336:0:6931:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1782727664.769357:0:6931:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.108@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782727664.769361:0:6931:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782727664.769366:0:6931:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1782727664.769370:0:6931:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1782727664.769382:0:6931:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91fcd21619d0) 00000020:00000080:1.0:1782727664.769390:0:6931:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1782727664.777216:0:6931:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782727664.780121:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1782727664.780133:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1782727664.791670:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1782727664.791682:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1782727664.792363:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1782727664.792377:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1782727664.795741:0:6931:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727664.796199:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1782727664.796205:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1782727664.798171:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1782727664.798184:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1782727664.834689:0:6931:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782727664.835235:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1782727664.835313:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1782727664.838658:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782727664.838679:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1782727664.840198:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782727664.840208:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1782727664.845211:0:6931:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782727664.845484:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1782727664.845490:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782727664.846891:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782727664.847016:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782727664.915326:0:6931:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727664.915631:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782727664.915638:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782727664.917632:0:6931:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782727664.917643:0:6931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782727664.918317:0:6931:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782727664.918353:0:6931:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1782727664.918359:0:6931:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1782727664.942628:0:6931:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782727664.942668:0:6931:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.108@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1782727664.942672:0:6931:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782727664.942674:0:6931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782727664.942676:0:6931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727664.942677:0:6931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727664.942678:0:6931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727664.942680:0:6931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727664.942681:0:6931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727664.942683:0:6931:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727664.942685:0:6931:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727664.942686:0:6931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727664.942688:0:6931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727664.942692:0:6931:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1782727664.942694:0:6931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782727664.942696:0:6931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782727664.942697:0:6931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727664.942698:0:6931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727664.942699:0:6931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727664.942700:0:6931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727664.942701:0:6931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727664.942702:0:6931:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727664.942703:0:6931:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727664.942704:0:6931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727664.942705:0:6931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727664.942734:0:6931:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782727664.942751:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347591296:0@lo:253: 00000100:00100000:3.0:1782727664.943001:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727664.943118:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d8a180 going to sleep for 11 seconds 00000100:00100000:2.0:1782727664.943229:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347591296 00000100:00100000:2.0:1782727664.943293:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347591296 00000100:00100000:2.0:1782727664.943385:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782727664.943395:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347591296:12345-0@lo:253: 20000000:01000000:2.0:1782727664.943453:0:5946:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1782727664.943458:0:5946:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1782727664.943464:0:5946:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1782727664.943467:0:5946:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1782727664.943698:0:5946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727664.943839:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1782727664.943857:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1782727664.943884:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1782727664.943892:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1782727664.944345:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1782727664.944365:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1782727664.944611:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1782727664.944628:0:5946:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:2.0:1782727664.944631:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:2.0:1782727664.944646:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1782727664.944651:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782727664.944665:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1782727664.944670:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:2.0:1782727664.944684:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1782727664.944691:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1782727664.944704:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1782727664.944720:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1782727664.945610:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1782727664.945630:0:5946:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:2.0:1782727664.945631:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:2.0:1782727664.945650:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1782727664.945657:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782727664.945668:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1782727664.945673:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:2.0:1782727664.945688:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1782727664.945693:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1782727664.945705:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1782727664.945718:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1782727664.945731:0:5946:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782727664.945734:0:5946:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782727664.945739:0:5946:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782727664.945860:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782727664.945864:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782727664.947130:0:6950:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1782727664.947162:0:6950:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1782727664.947176:0:6950:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1782727664.947671:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1782727664.947692:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1782727664.947710:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1782727664.947721:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782727664.947722:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782727664.948383:0:6951:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1782727664.948405:0:6951:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1782727664.948418:0:6951:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1782727664.948731:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1782727664.948764:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1782727664.948852:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1782727664.948863:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782727664.948865:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782727664.949340:0:6952:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1782727664.949647:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1782727664.949665:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1782727664.949678:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:2.0:1782727664.949692:0:5946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782727664.949713:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.949731:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcd346ce00/0xb393e873fab640ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab640e6 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.949738:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fd020ec800/0xb393e873fab64109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64102 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.949745:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc0030400/0xb393e873fab64179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64172 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.949752:0:5946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.949862:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc0030400/0xb393e873fab64179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64172 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.949878:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc0030400/0xb393e873fab64179 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64172 expref: 12 pid: 5945 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727664.950015:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347591424:0@lo:104: 00000100:00100000:2.0:1782727664.950097:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727664.950209:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fd020ec800/0xb393e873fab64109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64102 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.950218:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fd020ec800/0xb393e873fab64109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64102 expref: 12 pid: 5946 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727664.950227:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ea300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347591552:0@lo:104: 00000100:00100000:2.0:1782727664.950264:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727664.950472:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcd346ce00/0xb393e873fab640ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab640e6 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.950482:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcd346ce00/0xb393e873fab640ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab640e6 expref: 12 pid: 5945 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727664.950491:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ead80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347591680:0@lo:104: 00000100:00100000:2.0:1782727664.950513:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727664.950682:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347591424 00000100:00100000:3.0:1782727664.950691:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347591424 00000100:00100000:3.0:1782727664.950731:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347591552 00000100:00100000:3.0:1782727664.950733:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347591552 00000100:00100000:3.0:1782727664.950747:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727664.950756:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:5946:x1869325347591424:12345-0@lo:104: 00010000:00010000:3.0:1782727664.950768:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.950823:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727664.950829:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:5946:x1869325347591424:12345-0@lo:104: Request processed in 74us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727664.950836:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727664.950850:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727664.950855:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5946:x1869325347591552:12345-0@lo:104: 00010000:00010000:3.0:1782727664.950862:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fd020ed600/0xb393e873fab64102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.950890:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782727664.950895:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5946:x1869325347591552:12345-0@lo:104: Request processed in 40us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727664.950914:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1782727664.950930:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727664.950936:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.950943:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567be00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:3.0:1782727664.950955:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.950965:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727664.950971:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727664.950977:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727664.951004:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951011:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727664.951026:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64172 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951033:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64179 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951057:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727664.951060:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fd020ed600/0xb393e873fab64102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951066:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fd020ed600 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:3.0:1782727664.951069:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fd020ed600/0xb393e873fab64102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951076:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fd020ed600/0xb393e873fab64102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727664.951092:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fd020ed600/0xb393e873fab64102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727664.951098:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727664.951110:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fd020ed600/0xb393e873fab64102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951115:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727664.951128:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fd020ed600/0xb393e873fab64102 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951135:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fd020ed600/0xb393e873fab64102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64109 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951146:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727664.951148:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727664.951149:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727664.951169:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347591808:0@lo:103: 00000100:00100000:3.0:1782727664.951195:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727664.951461:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347591936:0@lo:103: 00000100:00100000:3.0:1782727664.951489:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727664.951545:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347591808 00000100:00100000:3.0:1782727664.951549:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347591808 00010000:00010000:3.0:1782727664.951568:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc0030400/0xb393e873fab64179 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64172 expref: 13 pid: 5945 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727664.951585:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347591936 00000100:00100000:3.0:1782727664.951588:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347591936 00010000:00010000:3.0:1782727664.951598:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fd020ec800/0xb393e873fab64109 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64102 expref: 14 pid: 5946 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727664.951619:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727664.951625:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:3443:x1869325347591808:12345-0@lo:103: 00010000:00010000:3.0:1782727664.951636:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727664.951641:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc0030400/0xb393e873fab64179 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64172 expref: 14 pid: 5945 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951652:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc0030400/0xb393e873fab64179 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64172 expref: 14 pid: 5945 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951668:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727664.951699:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:3443:x1869325347591808:12345-0@lo:103: Request processed in 73us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727664.951705:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727664.951718:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727664.951724:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:3444:x1869325347591936:12345-0@lo:103: 00010000:00010000:3.0:1782727664.951746:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727664.951750:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fd020ec800/0xb393e873fab64109 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64102 expref: 13 pid: 5946 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951759:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fd020ec800/0xb393e873fab64109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64102 expref: 13 pid: 5946 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.951767:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727664.951793:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:3444:x1869325347591936:12345-0@lo:103: Request processed in 69us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727664.951799:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727664.951830:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347591808:0@lo:103: 00000100:00100000:3.0:1782727664.951864:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347591936:0@lo:103: 00010000:00010000:1.0:1782727664.952199:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727664.952441:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd2132a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782727664.952462:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc0030400/0xb393e873fab64179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64172 expref: 12 pid: 5945 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727664.952477:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347591424:0@lo:104: 00010000:00010000:2.0:1782727664.952488:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fd020ec800/0xb393e873fab64109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64102 expref: 11 pid: 5946 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727664.952497:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ea300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347591552:0@lo:104: 00000100:00100000:3.0:1782727664.952755:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347591680 00000100:00100000:3.0:1782727664.952762:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347591680 00000100:00100000:3.0:1782727664.952865:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727664.952872:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5946:x1869325347591680:12345-0@lo:104: 00010000:00010000:3.0:1782727664.952885:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fd020ece00/0xb393e873fab640e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727664.953085:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727664.953092:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5946:x1869325347591680:12345-0@lo:104: Request processed in 221us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727664.953099:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782727664.953156:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727664.953163:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fd020ece00/0xb393e873fab640e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953184:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fd020ece00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:1.0:1782727664.953189:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fd020ece00/0xb393e873fab640e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953198:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fd020ece00/0xb393e873fab640e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727664.953205:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fd020ece00/0xb393e873fab640e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727664.953211:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727664.953325:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fd020ece00/0xb393e873fab640e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953332:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727664.953354:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fd020ece00/0xb393e873fab640e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953362:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fd020ece00/0xb393e873fab640e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab640ed expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953380:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727664.953382:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727664.953384:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727664.953397:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347592064:0@lo:103: 00000100:00100000:1.0:1782727664.953467:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727664.953519:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347592064 00000100:00100000:1.0:1782727664.953523:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347592064 00010000:00010000:1.0:1782727664.953613:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcd346ce00/0xb393e873fab640ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab640e6 expref: 11 pid: 5945 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727664.953642:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727664.953647:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:3445:x1869325347592064:12345-0@lo:103: 00010000:00010000:1.0:1782727664.953671:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727664.953677:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcd346ce00/0xb393e873fab640ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab640e6 expref: 11 pid: 5945 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953686:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcd346ce00/0xb393e873fab640ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab640e6 expref: 11 pid: 5945 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953701:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953710:0:5936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953725:0:5936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953731:0:5936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953737:0:5936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953742:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953746:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a77800 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:1.0:1782727664.953750:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953762:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.953769:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.954006:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcd346ce00/0xb393e873fab640ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab640e6 expref: 11 pid: 5945 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727664.954025:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ead80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347591680:0@lo:104: 00010000:00010000:2.0:1782727664.954060:0:5946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.954069:0:5946:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.954076:0:5946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782727664.954085:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1782727664.954140:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcf3a77800/0xb393e873fab641d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.954156:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727664.954196:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:3445:x1869325347592064:12345-0@lo:103: Request processed in 548us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727664.954203:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727664.954501:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347592064:0@lo:103: 00000100:00100000:2.0:1782727664.957849:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:6931:x1869325347591296:12345-0@lo:253: Request processed in 14440us (14834us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727664.957868:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727664.958196:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347591296:0@lo:253: 10000000:01000000:0.0:1782727664.958214:0:6931:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782727664.958218:0:6931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782727664.958220:0:6931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727664.958222:0:6931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727664.958223:0:6931:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1782727664.958225:0:6931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727664.958226:0:6931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727664.958228:0:6931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727664.958230:0:6931:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782727664.958231:0:6931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727664.958233:0:6931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782727664.958338:0:6931:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91fcf9d2c000 from lustre-OST0000 10000000:01000000:0.0:1782727664.958375:0:6931:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1782727664.958377:0:6931:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782727664.958399:0:6931:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91fcf9dc33a0 local copy 10000000:01000000:0.0:1782727664.958404:0:6931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782727664.958486:0:6931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.958500:0:6931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.958511:0:6931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727664.958550:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592192:0@lo:101: 00000100:00100000:0.0:1782727664.958602:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727664.958650:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc3dc4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727664.958845:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347592192 00000100:00100000:2.0:1782727664.958852:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347592192 00000100:00100000:2.0:1782727664.959027:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782727664.959038:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:6931:x1869325347592192:12345-0@lo:101: 00010000:00010000:2.0:1782727664.959062:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727664.959080:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcf3a76400/0xb393e873fab641e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab641db expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.959106:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a76400/0xb393e873fab641e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab641db expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.959118:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcf3a76400/0xb393e873fab641e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab641db expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.959135:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a76400, rc 0) 00000100:00100000:2.0:1782727664.959179:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:6931:x1869325347592192:12345-0@lo:101: Request processed in 144us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727664.959186:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782727664.959356:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592192:0@lo:101: 00010000:00010000:1.0:1782727664.959372:0:6931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.959381:0:6931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727664.959512:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592320:0@lo:501: 00000100:00100000:1.0:1782727664.959615:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727664.959633:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfb600 going to sleep for 11 seconds 00000100:00100000:0.0:1782727664.959697:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347592320 00000100:00100000:0.0:1782727664.959702:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347592320 00000100:00100000:0.0:1782727664.959738:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782727664.959745:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:6931:x1869325347592320:12345-0@lo:501: 00000100:00100000:0.0:1782727664.960061:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:6931:x1869325347592320:12345-0@lo:501: Request processed in 316us (445us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727664.960069:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782727664.960178:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592320:0@lo:501: 10000000:01000000:1.0:1782727664.960192:0:6931:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782727664.960209:0:6931:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782727664.960214:0:6931:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.960230:0:6931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.960314:0:6931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.960342:0:6931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782727664.960371:0:6931:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91fcf9d2c000 10000000:01000000:1.0:1782727664.960376:0:6931:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782727664.960381:0:6931:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91fcf9dc33a0 10000000:01000000:1.0:1782727664.960384:0:6931:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1782727664.960387:0:6931:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91fcf9dc33a0 from 1 10000000:01000000:1.0:1782727664.960390:0:6931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782727664.960419:0:6931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567b200/0xb393e873fab641e9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.960481:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727664.960487:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.960495:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc0031600 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:0.0:1782727664.960499:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.960508:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727664.960522:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.960620:0:6931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc567b200/0xb393e873fab641e9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.960629:0:6931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc567b200/0xb393e873fab641e9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727664.960644:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592448:0@lo:101: 00000100:00100000:1.0:1782727664.960673:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1782727664.960719:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727664.960738:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.960744:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727664.960769:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.960786:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab641db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb393e873fab641e2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.960802:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727664.960803:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727664.960805:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727664.960911:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727664.961111:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347592576:0@lo:103: 00000100:00100000:3.0:1782727664.961142:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727664.961232:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347592576 00000100:00100000:1.0:1782727664.961302:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347592576 00000100:00100000:1.0:1782727664.961347:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727664.961356:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:3442:x1869325347592576:12345-0@lo:103: 00010000:00010000:1.0:1782727664.961380:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727664.961395:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcf3a76400/0xb393e873fab641e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb393e873fab641db expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.961410:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727664.961488:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:3442:x1869325347592576:12345-0@lo:103: Request processed in 134us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727664.961496:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727664.961677:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347592576:0@lo:103: 00000100:00100000:2.0:1782727664.961879:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347592448 00000100:00100000:2.0:1782727664.961884:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347592448 00000100:00100000:2.0:1782727664.962062:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782727664.962071:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:6931:x1869325347592448:12345-0@lo:101: 00010000:00010000:2.0:1782727664.962081:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727664.962094:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcf3a77200/0xb393e873fab641f0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab641e9 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.962114:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a77200/0xb393e873fab641f0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab641e9 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.962122:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcf3a77200/0xb393e873fab641f0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab641e9 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727664.962129:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77200, rc 0) 00000100:00100000:2.0:1782727664.962172:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:6931:x1869325347592448:12345-0@lo:101: Request processed in 103us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727664.962178:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782727664.962236:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592448:0@lo:101: 00010000:00010000:1.0:1782727664.962260:0:6931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc567b200/0xb393e873fab641e9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641f0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.962268:0:6931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc567b200/0xb393e873fab641e9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab641f0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727664.962293:0:6931:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782727664.962307:0:6931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567b200/0xb393e873fab641e9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641f0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.962315:0:6931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc567b200/0xb393e873fab641e9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641f0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727664.962323:0:6931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782727664.962327:0:6931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727664.962333:0:6931:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1782727664.962335:0:6931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782727664.962353:0:6931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.962372:0:6931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.962380:0:6931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727664.962394:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592704:0@lo:101: 00000100:00100000:1.0:1782727664.962444:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727664.963170:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727664.963317:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347592704 00000100:00100000:0.0:1782727664.963323:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347592704 00000100:00100000:0.0:1782727664.963354:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782727664.963360:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:6931:x1869325347592704:12345-0@lo:101: 00010000:00010000:0.0:1782727664.963370:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727664.963384:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc0030400/0xb393e873fab641fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab641f7 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.963402:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc0030400/0xb393e873fab641fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab641f7 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.963452:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc0030400/0xb393e873fab641fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab641f7 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727664.963460:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0030400, rc 0) 00000100:00100000:0.0:1782727664.963505:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:6931:x1869325347592704:12345-0@lo:101: Request processed in 144us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727664.963511:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782727664.963652:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592704:0@lo:101: 00010000:00010000:1.0:1782727664.963666:0:6931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727664.963674:0:6931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727664.963759:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592832:0@lo:501: 00000100:00100000:1.0:1782727664.963801:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727664.964076:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727664.964132:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347592832 00000100:00100000:2.0:1782727664.964137:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347592832 00000100:00100000:2.0:1782727664.964159:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782727664.964165:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:6931:x1869325347592832:12345-0@lo:501: 00000100:00100000:2.0:1782727664.964341:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:6931:x1869325347592832:12345-0@lo:501: Request processed in 175us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727664.964356:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782727664.964446:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592832:0@lo:501: 00000100:00100000:1.0:1782727664.964492:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592960:0@lo:503: 00000100:00100000:1.0:1782727664.964538:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727664.964553:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727664.964669:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347592960 00000100:00100000:2.0:1782727664.964673:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347592960 00000100:00100000:2.0:1782727664.964691:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782727664.964697:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:6931:x1869325347592960:12345-0@lo:503: 00000100:00100000:2.0:1782727664.964763:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:6931:x1869325347592960:12345-0@lo:503: Request processed in 65us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727664.964769:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782727664.964924:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347592960:0@lo:503: 00000040:00080000:1.0:1782727664.965192:0:6931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782727664.965283:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593088:0@lo:502: 00000100:00100000:1.0:1782727664.965319:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727664.965341:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727664.965641:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347593088 00000100:00100000:2.0:1782727664.965646:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347593088 00000100:00100000:2.0:1782727664.965668:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782727664.965673:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:6931:x1869325347593088:12345-0@lo:502: 00000100:00100000:2.0:1782727664.966848:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:6931:x1869325347593088:12345-0@lo:502: Request processed in 1163us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727664.966859:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782727664.967260:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593088:0@lo:502: 00000040:00080000:1.0:1782727664.967646:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782727664.967683:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1782727664.967695:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1782727664.967705:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1782727664.967716:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1782727664.967726:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1782727664.967765:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593216:0@lo:502: 00000100:00100000:1.0:1782727664.967830:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727664.967858:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727664.968189:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347593216 00000100:00100000:2.0:1782727664.968198:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347593216 00000100:00100000:2.0:1782727664.968256:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782727664.968266:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:6931:x1869325347593216:12345-0@lo:502: 00000100:00100000:2.0:1782727664.968393:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:6931:x1869325347593216:12345-0@lo:502: Request processed in 127us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727664.968400:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727664.968688:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593216:0@lo:502: 00000040:00080000:1.0:1782727664.968754:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1782727664.968764:0:6931:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1782727664.969799:0:6953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782727664.969808:0:6953:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1782727664.969815:0:6953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727664.969817:0:6953:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782727664.969822:0:6953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782727664.969844:0:6953:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91fcde8033a0) 00000020:00000080:2.0:1782727664.969863:0:6953:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782727664.969869:0:6953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782727664.969995:0:6953:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91fcf9d2c000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1782727664.970003:0:6953:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782727664.970009:0:6953:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb393e873fab6420c 00010000:00010000:2.0:1782727664.984032:0:6953:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1782727664.984822:0:6953:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1782727664.988002:0:6953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1782727664.990718:0:6953:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1782727665.007101:0:6953:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1782727665.007725:0:6953:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1782727665.014717:0:6953:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1782727665.016343:0:6953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782727665.016360:0:6953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727665.016369:0:6953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727665.016371:0:6953:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782727665.016375:0:6953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727665.016379:0:6953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727665.016380:0:6953:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727665.016383:0:6953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727665.016385:0:6953:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782727665.016412:0:6953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727665.016416:0:6953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727665.016417:0:6953:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727665.016420:0:6953:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1782727665.017712:0:6931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1782727665.017751:0:6931:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782727665.017776:0:6931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727665.017790:0:6931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727665.017799:0:6931:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91fcf9d2c000 from 1 10000000:01000000:3.0:1782727665.017802:0:6931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727665.017851:0:6931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727665.017860:0:6931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727665.017870:0:6931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727665.017893:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593344:0@lo:101: 00000100:00100000:3.0:1782727665.018701:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727665.018773:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d8a600 going to sleep for 11 seconds 00000100:00100000:0.0:1782727665.019647:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347593344 00000100:00100000:0.0:1782727665.019658:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347593344 00000100:00100000:0.0:1782727665.019709:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782727665.019719:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:6931:x1869325347593344:12345-0@lo:101: 00010000:00010000:0.0:1782727665.019734:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727665.019748:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc0031600/0xb393e873fab6421a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64213 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.019773:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc0031600/0xb393e873fab6421a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64213 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.019791:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc0031600/0xb393e873fab6421a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64213 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.019801:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0031600, rc 0) 00000100:00100000:0.0:1782727665.019856:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347593344:12345-0@lo:101: Request processed in 138us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727665.019863:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782727665.020006:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593344:0@lo:101: 00010000:00010000:1.0:1782727665.020024:0:6931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727665.020033:0:6931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727665.020158:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593472:0@lo:501: 00000100:00100000:1.0:1782727665.020189:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727665.020215:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347593472 00000100:00100000:1.0:1782727665.020219:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347593472 00000100:00100000:1.0:1782727665.020253:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782727665.020266:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347593472:12345-0@lo:501: 00000100:00100000:1.0:1782727665.020369:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347593472:12345-0@lo:501: Request processed in 102us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727665.020376:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782727665.020411:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727665.020450:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593472:0@lo:501: 00000100:00100000:1.0:1782727665.020490:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593600:0@lo:503: 00000100:00100000:1.0:1782727665.020648:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727665.020671:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347593600 00000100:00100000:1.0:1782727665.020675:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347593600 00000100:00100000:1.0:1782727665.020691:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782727665.020696:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347593600:12345-0@lo:503: 00000100:00100000:1.0:1782727665.020760:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347593600:12345-0@lo:503: Request processed in 62us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727665.020766:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782727665.020800:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727665.020812:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593600:0@lo:503: 00000040:00080000:1.0:1782727665.021807:0:6931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782727665.022774:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593728:0@lo:502: 00000100:00100000:1.0:1782727665.022836:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727665.022893:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727665.023057:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347593728 00000100:00100000:3.0:1782727665.023063:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347593728 00000100:00100000:3.0:1782727665.023109:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782727665.023117:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347593728:12345-0@lo:502: 00000100:00100000:3.0:1782727665.023217:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347593728:12345-0@lo:502: Request processed in 101us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727665.023224:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782727665.023722:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593728:0@lo:502: 00000040:00080000:1.0:1782727665.023934:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1782727665.023960:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1782727665.023982:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593856:0@lo:502: 00000100:00100000:1.0:1782727665.024024:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727665.024056:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727665.024252:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347593856 00000100:00100000:3.0:1782727665.024264:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347593856 00000100:00100000:3.0:1782727665.024304:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782727665.024310:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347593856:12345-0@lo:502: 00000100:00100000:3.0:1782727665.024386:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347593856:12345-0@lo:502: Request processed in 75us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727665.024392:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782727665.024783:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593856:0@lo:502: 00000040:00080000:1.0:1782727665.024825:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1782727665.024833:0:6931:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1782727665.025656:0:6957:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727665.025672:0:6957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727665.025675:0:6957:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782727665.025685:0:6957:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91fcf9d2c000 00000020:00000080:3.0:1782727665.025688:0:6957:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782727665.025702:0:6957:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727665.025704:0:6957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727665.025706:0:6957:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782727665.025708:0:6957:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1782727665.026177:0:6931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782727665.026200:0:6931:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727665.026220:0:6931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727665.026232:0:6931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727665.026282:0:6931:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782727665.026285:0:6931:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91fcf9d2c000 10000000:01000000:1.0:1782727665.026288:0:6931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91fcf9d2c000 10000000:01000000:1.0:1782727665.026292:0:6931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727665.026298:0:6931:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91fcf9d2c000 from 1 10000000:01000000:1.0:1782727665.026301:0:6931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727665.026328:0:6931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727665.026336:0:6931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727665.026345:0:6931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727665.026361:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593984:0@lo:101: 00000100:00100000:1.0:1782727665.026413:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727665.026723:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfb540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727665.034038:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347593984 00000100:00100000:2.0:1782727665.034063:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347593984 00000100:00100000:2.0:1782727665.034133:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782727665.034144:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:6931:x1869325347593984:12345-0@lo:101: 00010000:00010000:2.0:1782727665.034165:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727665.034186:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcf3a77600/0xb393e873fab64228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64221 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727665.034218:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a77600/0xb393e873fab64228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64221 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727665.034229:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcf3a77600/0xb393e873fab64228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64221 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727665.034252:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77600, rc 0) 00000100:00100000:2.0:1782727665.034326:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347593984:12345-0@lo:101: Request processed in 184us (7912us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727665.034334:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782727665.036175:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347593984:0@lo:101: 00010000:00010000:1.0:1782727665.036207:0:6931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727665.036221:0:6931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727665.036419:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347594112:0@lo:501: 00000100:00100000:1.0:1782727665.037061:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727665.037648:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9dfb540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727665.039066:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347594112 00000100:00100000:2.0:1782727665.039077:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347594112 00000100:00100000:2.0:1782727665.039167:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782727665.039191:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347594112:12345-0@lo:501: 00000100:00100000:2.0:1782727665.039375:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347594112:12345-0@lo:501: Request processed in 184us (2313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727665.039383:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782727665.039520:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347594112:0@lo:501: 00000100:00100000:3.0:1782727665.039587:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347594240:0@lo:503: 00000100:00100000:3.0:1782727665.039634:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727665.040123:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d8af00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727665.040206:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347594240 00000100:00100000:1.0:1782727665.040213:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347594240 00000100:00100000:1.0:1782727665.040251:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782727665.040259:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347594240:12345-0@lo:503: 00000100:00100000:1.0:1782727665.040356:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347594240:12345-0@lo:503: Request processed in 97us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727665.040364:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727665.040516:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347594240:0@lo:503: 00000040:00080000:3.0:1782727665.040806:0:6931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782727665.040892:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347594368:0@lo:502: 00000100:00100000:3.0:1782727665.040941:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727665.040972:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d8af00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727665.041209:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347594368 00000100:00100000:1.0:1782727665.041215:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347594368 00000100:00100000:1.0:1782727665.041250:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782727665.041257:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347594368:12345-0@lo:502: 00000100:00100000:1.0:1782727665.041349:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347594368:12345-0@lo:502: Request processed in 91us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727665.041356:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727665.041571:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347594368:0@lo:502: 00000040:00080000:3.0:1782727665.041776:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1782727665.041803:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1782727665.041816:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1782727665.041829:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1782727665.041840:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1782727665.041853:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1782727665.041867:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1782727665.042064:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1782727665.042081:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1782727665.042094:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1782727665.042125:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1782727665.042141:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1782727665.042154:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1782727665.042176:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1782727665.042187:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1782727665.042197:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1782727665.042208:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1782727665.042218:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1782727665.042228:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1782727665.042250:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1782727665.042263:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1782727665.042273:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1782727665.042285:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1782727665.042299:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1782727665.042310:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1782727665.042321:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1782727665.042344:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1782727665.042355:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1782727665.042383:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347594496:0@lo:502: 00000100:00100000:3.0:1782727665.042600:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727665.042672:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d8af00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727665.042735:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347594496 00000100:00100000:2.0:1782727665.042743:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347594496 00000100:00100000:1.0:1782727665.043098:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782727665.043111:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347594496:12345-0@lo:502: 00000100:00100000:1.0:1782727665.043274:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347594496:12345-0@lo:502: Request processed in 165us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727665.043282:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782727665.043481:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347594496:0@lo:502: 00000040:00080000:3.0:1782727665.043798:0:6931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782727665.043811:0:6931:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1782727665.044748:0:6958:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1782727665.044763:0:6958:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91fcd2160000) 00000020:00000080:1.0:1782727665.044785:0:6958:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1782727665.045026:0:6958:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91fcf9d2c000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782727665.045032:0:6958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91fcf9d2c000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782727665.045035:0:6958:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91fcf9d2c000 3 00010000:00080000:1.0:1782727665.045100:0:6958:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91fcfde99800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.108@tcp at head 00010000:00010000:1.0:1782727665.046809:0:6958:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1782727665.046978:0:6958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782727665.047034:0:6958:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782727665.047071:0:6958:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb393e873fab64236 00000100:00080000:1.0:1782727665.047086:0:6958:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782727665.047094:0:6958:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91fcfde99800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1782727665.047160:0:6958:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91fcec54c700 x1869325347594624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782727665.047196:0:6958:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782727665.047647:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3441:1869325347594624:0@lo:38: 00000100:00100000:0.0:1782727665.047740:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727665.051574:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347594752:0@lo:400: 00000100:00100000:3.0:1782727665.051732:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727665.051795:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347594624 00000100:00100000:3.0:1782727665.051802:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347594624 00000100:00100000:3.0:1782727665.051828:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347594752 00000100:00100000:3.0:1782727665.051830:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347594752 00000100:00100000:3.0:1782727665.051859:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727665.051868:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347594752:12345-0@lo:400: 00000100:00100000:3.0:1782727665.052074:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347594752:12345-0@lo:400: Request processed in 205us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727665.052093:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727665.052111:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727665.052116:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3441:x1869325347594624:12345-0@lo:38: 00010000:00080000:3.0:1782727665.052136:0:5953:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:3.0:1782727665.052187:0:5953:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb393e873fab6423d 00000004:00100000:3.0:1782727665.052202:0:5953:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782727665.052233:0:5953:0:(import.c:65:import_set_state_nolock()) ffff91fcd3d07800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782727665.052658:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1869325347594624:12345-0@lo:38: Request processed in 539us (4917us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727665.052664:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782727665.052704:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91fcf3a66d80 x1869325347594752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727665.052718:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347594752:0@lo:400: 00010000:00080000:3.0:1782727665.052751:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91fcec54c700 x1869325347594624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727665.052760:0:3441:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782727665.052766:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1782727665.052772:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782727665.052776:0:3441:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782727665.052779:0:3441:0:(import.c:65:import_set_state_nolock()) ffff91fcfde99800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782727665.052784:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3441:1869325347594624:0@lo:38: 00000040:00080000:3.0:1782727665.053403:0:6958:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1782727665.055156:0:6931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1782727665.055199:0:6931:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727665.055223:0:6931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.055629:0:6931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782727665.055695:0:6931:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782727665.055698:0:6931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727665.055699:0:6931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727665.055700:0:6931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727665.055702:0:6931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727665.055703:0:6931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727665.055705:0:6931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727665.055706:0:6931:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727665.055708:0:6931:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727665.055710:0:6931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727665.055711:0:6931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782727665.055715:0:6931:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1782727665.055718:0:6931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782727665.055719:0:6931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727665.055724:0:6931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727665.055725:0:6931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727665.055726:0:6931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727665.055727:0:6931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727665.055728:0:6931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727665.055729:0:6931:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727665.055730:0:6931:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727665.055731:0:6931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727665.055732:0:6931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782727665.055759:0:6931:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782727665.055777:0:6931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347594880:0@lo:253: 00000100:00100000:0.0:1782727665.055841:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727665.056327:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347594880 00000100:00100000:1.0:1782727665.056335:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347594880 00000100:00100000:1.0:1782727665.056382:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782727665.056392:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347594880:12345-0@lo:253: 20000000:01000000:1.0:1782727665.056446:0:5946:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782727665.056464:0:5946:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1782727665.057077:0:6931:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc3dc4e40 going to sleep for 11 seconds 20000000:01000000:0.0:1782727665.077654:0:5946:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782727665.077727:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782727665.078230:0:5967:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782727665.078310:0:5967:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782727665.078338:0:5967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727665.078361:0:5967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcd346c000/0xb393e873fab641a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab6419c expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727665.078371:0:5967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727665.078415:0:5967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcd346c000/0xb393e873fab641a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab6419c expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727665.078699:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:6931:x1869325347594880:12345-0@lo:253: Request processed in 22305us (22854us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727665.078712:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782727665.079158:0:6931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:6931:1869325347594880:0@lo:253: 10000000:01000000:1.0:1782727665.079177:0:6931:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782727665.079189:0:6931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782727665.079191:0:6931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782727665.079193:0:6931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727665.079194:0:6931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727665.079195:0:6931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727665.079197:0:6931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727665.079199:0:6931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727665.079200:0:6931:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727665.079201:0:6931:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727665.079203:0:6931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727665.079204:0:6931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782727665.079224:0:6931:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1782727665.079668:0:5967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcd346c000/0xb393e873fab641a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab6419c expref: 12 pid: 5946 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727665.079687:0:5967:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ead80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5967:1869325347595008:0@lo:104: 00000100:00100000:2.0:1782727665.079737:0:5967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727665.079812:0:5967:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fccf7440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727665.081034:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347595008 00000100:00100000:0.0:1782727665.081053:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347595008 00000100:00100000:0.0:1782727665.081119:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727665.081128:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5967:x1869325347595008:12345-0@lo:104: 00010000:00010000:0.0:1782727665.081148:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcc0030e00/0xb393e873fab6419c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081257:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727665.081262:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5967:x1869325347595008:12345-0@lo:104: Request processed in 136us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727665.081270:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1782727665.081300:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727665.081306:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc0030e00/0xb393e873fab6419c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081334:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc0030e00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:0.0:1782727665.081339:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0030e00/0xb393e873fab6419c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081349:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc0030e00/0xb393e873fab6419c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727665.081356:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0030e00/0xb393e873fab6419c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727665.081362:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727665.081413:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc0030e00/0xb393e873fab6419c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081460:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727665.081487:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc0030e00/0xb393e873fab6419c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081494:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc0030e00/0xb393e873fab6419c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab641a3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081518:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727665.081520:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727665.081521:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727665.081551:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347595136:0@lo:103: 00000100:00100000:0.0:1782727665.081600:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727665.081688:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347595136 00000100:00100000:0.0:1782727665.081692:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347595136 00010000:00010000:0.0:1782727665.081716:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcd346c000/0xb393e873fab641a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab6419c expref: 13 pid: 5946 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727665.081753:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727665.081759:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcde698450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:3444:x1869325347595136:12345-0@lo:103: 00010000:00010000:0.0:1782727665.081776:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727665.081783:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcd346c000/0xb393e873fab641a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab6419c expref: 13 pid: 5946 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081795:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcd346c000/0xb393e873fab641a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab6419c expref: 13 pid: 5946 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081818:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081827:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782727665.081846:0:5937:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003608742s 00010000:00010000:0.0:1782727665.081852:0:5937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081860:0:5937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081867:0:5937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081873:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081879:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76e00 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:0.0:1782727665.081884:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081910:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081921:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.081931:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727665.081963:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcde698450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:3444:x1869325347595136:12345-0@lo:103: Request processed in 204us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727665.081970:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727665.082060:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347595136:0@lo:103: 00010000:00010000:0.0:1782727665.082092:0:5967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcd346c000/0xb393e873fab641a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab6419c expref: 12 pid: 5946 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727665.082103:0:5967:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ead80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5967:1869325347595008:0@lo:104: 00010000:00010000:0.0:1782727665.082118:0:5967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.082128:0:5967:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.082133:0:5967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727665.082139:0:5967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64244 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1782727665.090567:0:6931:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1782727665.090775:0:6931:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1782727665.091874:0:6931:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1782727665.092539:0:6931:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1782727665.093139:0:6931:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1782727665.094591:0:6931:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1782727665.097137:0:6931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1782727665.113338:0:6931:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1782727665.113350:0:6931:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1782727665.113390:0:6931:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782727665.113475:0:6931:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782727665.113503:0:6931:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1782727665.113627:0:6931:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1782727665.115056:0:6931:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727665.115408:0:6931:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1782727665.693565:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782727666.112394:0:7012:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727666.113152:0:7012:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727666.717953:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782727666.980981:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782727666.980991:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91fcc90cc800 from 21 10000000:01000000:0.0:1782727666.980997:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727666.981066:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727666.981080:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727666.981094:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727666.981126:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347595264:0@lo:101: 00000100:00100000:0.0:1782727666.981586:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727666.981652:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0b9c180 going to sleep for 11 seconds 00000100:00100000:1.0:1782727666.982926:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347595264 00000100:00100000:1.0:1782727666.982939:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347595264 00000100:00100000:1.0:1782727666.983009:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782727666.983037:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347595264:12345-0@lo:101: 00010000:00010000:1.0:1782727666.983054:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727666.983071:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567bc00/0xb393e873fab64252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab6424b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727666.983100:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567bc00/0xb393e873fab64252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab6424b expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727666.983112:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567bc00/0xb393e873fab64252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab6424b expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727666.983122:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567bc00, rc 0) 00000100:00100000:1.0:1782727666.983190:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347595264:12345-0@lo:101: Request processed in 154us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727666.983196:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782727666.983253:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347595264:0@lo:101: 00010000:00010000:1.0:1782727666.983288:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727666.983298:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727666.983381:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347595392:0@lo:501: 00000100:00100000:1.0:1782727666.983412:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727666.983469:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0618480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727666.983888:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347595392 00000100:00100000:0.0:1782727666.983895:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347595392 00000100:00100000:0.0:1782727666.983925:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782727666.983931:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347595392:12345-0@lo:501: 00000100:00100000:0.0:1782727666.984080:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347595392:12345-0@lo:501: Request processed in 148us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727666.984088:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782727666.984100:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347595392:0@lo:501: 00000100:00100000:2.0:1782727666.984132:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347595520:0@lo:503: 00000100:00100000:2.0:1782727666.984172:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727666.984194:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf36db900 going to sleep for 11 seconds 00000100:00100000:0.0:1782727666.984264:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347595520 00000100:00100000:0.0:1782727666.984269:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347595520 00000100:00100000:0.0:1782727666.984300:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782727666.984307:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347595520:12345-0@lo:503: 00000100:00100000:0.0:1782727666.984389:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347595520:12345-0@lo:503: Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727666.984396:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782727666.984658:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347595520:0@lo:503: 00000100:00100000:2.0:1782727666.985501:0:7047:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:7047:1869325347595648:0@lo:502: 00000100:00100000:2.0:1782727666.985566:0:7047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727666.985601:0:7047:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf36dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727666.985991:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347595648 00000100:00100000:0.0:1782727666.985998:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347595648 00000100:00100000:0.0:1782727666.986096:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782727666.986106:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:7047:x1869325347595648:12345-0@lo:502: 00000100:00100000:0.0:1782727666.986264:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:7047:x1869325347595648:12345-0@lo:502: Request processed in 159us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727666.986272:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782727666.986310:0:7047:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:7047:1869325347595648:0@lo:502: 00000100:00100000:2.0:1782727666.986368:0:7047:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:7047:1869325347595776:0@lo:502: 00000100:00100000:2.0:1782727666.986409:0:7047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727666.997713:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347595776 00000100:00100000:1.0:1782727666.997733:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347595776 00000100:00100000:2.0:1782727666.997789:0:7047:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fec540 going to sleep for 11 seconds 00000100:00100000:1.0:1782727666.997996:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782727666.998007:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:7047:x1869325347595776:12345-0@lo:502: 00000100:00100000:1.0:1782727666.998196:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:7047:x1869325347595776:12345-0@lo:502: Request processed in 190us (11784us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727666.998314:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782727667.000137:0:7047:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:7047:1869325347595776:0@lo:502: 00000040:00080000:2.0:1782727667.000182:0:7047:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1782727667.003410:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1782727667.003605:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727667.003617:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727667.003629:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727667.003638:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782727667.003640:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91fcc90cc800 from 4 10000000:01000000:1.0:1782727667.003643:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782727667.003680:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727667.003698:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727667.003709:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727667.003733:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347595904:0@lo:101: 00000100:00100000:1.0:1782727667.004324:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727667.004365:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0618cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727667.004910:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347595904 00000100:00100000:0.0:1782727667.004918:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347595904 00000100:00100000:0.0:1782727667.004958:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782727667.004966:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347595904:12345-0@lo:101: 00010000:00010000:0.0:1782727667.004980:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727667.004995:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64259 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727667.005027:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64259 expref: 14 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727667.005037:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64259 expref: 14 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727667.005045:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0031c00, rc 0) 00000100:00100000:0.0:1782727667.005101:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347595904:12345-0@lo:101: Request processed in 135us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727667.005107:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782727667.005491:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347595904:0@lo:101: 00010000:00010000:2.0:1782727667.005506:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727667.005516:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727667.005575:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347596032:0@lo:256: 00000100:00100000:2.0:1782727667.005610:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727667.005654:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fec540 going to sleep for 11 seconds 00000100:00100000:1.0:1782727667.005664:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347596032 00000100:00100000:1.0:1782727667.005668:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347596032 00000100:00100000:1.0:1782727667.005698:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782727667.005705:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347596032:12345-0@lo:256: 20000000:01000000:1.0:1782727667.005717:0:5944:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782727667.005732:0:5944:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782727667.005735:0:5944:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1782727667.008363:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347596032:12345-0@lo:256: Request processed in 2646us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727667.008380:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782727667.012042:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347596032:0@lo:256: 10000000:01000000:2.0:1782727667.012114:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782727667.012125:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727667.012137:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727667.012148:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782727667.012151:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1782727667.012154:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782727667.012193:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727667.013591:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727667.013617:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727667.013645:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347596160:0@lo:101: 00000100:00100000:2.0:1782727667.013718:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727667.013938:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fec540 going to sleep for 11 seconds 00000100:00100000:1.0:1782727667.014064:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347596160 00000100:00100000:1.0:1782727667.014073:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347596160 00000100:00100000:1.0:1782727667.014143:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782727667.014153:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347596160:12345-0@lo:101: 00010000:00010000:1.0:1782727667.014170:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727667.014188:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567a800/0xb393e873fab6426e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64267 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727667.014291:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567a800/0xb393e873fab6426e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64267 expref: 15 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727667.014312:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567a800/0xb393e873fab6426e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64267 expref: 15 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727667.014322:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567a800, rc 0) 00000100:00100000:1.0:1782727667.014368:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347596160:12345-0@lo:101: Request processed in 217us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727667.014375:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782727667.014596:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347596160:0@lo:101: 00010000:00010000:2.0:1782727667.014613:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727667.014623:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727667.014689:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347596288:0@lo:501: 00000100:00100000:2.0:1782727667.014715:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727667.014736:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fec540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727667.014837:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347596288 00000100:00100000:2.0:1782727667.014923:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347596288 00000100:00100000:2.0:1782727667.014962:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727667.014969:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347596288:12345-0@lo:501: 00000100:00100000:2.0:1782727667.015117:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347596288:12345-0@lo:501: Request processed in 147us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727667.015124:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727667.015159:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347596288:0@lo:501: 00000100:00100000:2.0:1782727667.015185:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347596416:0@lo:503: 00000100:00100000:2.0:1782727667.015304:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727667.015320:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fec540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727667.015331:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347596416 00000100:00100000:2.0:1782727667.015335:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347596416 00000100:00100000:2.0:1782727667.015352:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782727667.015358:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347596416:12345-0@lo:503: 00000100:00100000:2.0:1782727667.015483:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347596416:12345-0@lo:503: Request processed in 124us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727667.015490:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782727667.015707:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347596416:0@lo:503: 00000100:00100000:3.0:1782727667.022156:0:7050:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a66d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:7050:1869325347596544:0@lo:502: 00000100:00100000:3.0:1782727667.024485:0:7050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727667.025964:0:7050:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc33946c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727667.026106:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347596544 00000100:00100000:2.0:1782727667.026116:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347596544 00000100:00100000:2.0:1782727667.026195:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782727667.026217:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc2477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:7050:x1869325347596544:12345-0@lo:502: 00000100:00100000:2.0:1782727667.026391:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc2477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:7050:x1869325347596544:12345-0@lo:502: Request processed in 186us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727667.026399:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782727667.028981:0:7050:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a66d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:7050:1869325347596544:0@lo:502: 00000020:01000000:3.0:1782727667.029048:0:7050:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782727667.029057:0:7050:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1782727667.029067:0:7050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727667.029069:0:7050:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782727667.029075:0:7050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782727667.029080:0:7050:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.108@tcp to nid 0x20000c0a8c96c (192.168.201.108@tcp) 00000020:01000000:3.0:1782727667.029106:0:7050:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782727667.029109:0:7050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727667.029139:0:7050:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91fcf3ac8000) 00000020:00000080:3.0:1782727667.029163:0:7050:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1782727667.029171:0:7050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782727667.029284:0:7050:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1782727667.029290:0:7050:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782727667.029297:0:7050:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb393e873fab6427c 00010000:00080000:3.0:1782727667.029332:0:7050:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91fcf9e51800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:3.0:1782727667.029631:0:7050:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1782727667.058669:0:7050:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782727667.058703:0:7050:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782727667.059126:0:7050:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727667.059327:0:7050:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727667.059419:0:7050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1782727667.059574:0:7050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1782727667.060081:0:7054:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782727667.060087:0:7054:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1782727667.062477:0:7050:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782727667.062499:0:7050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782727667.062544:0:7050:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782727667.062571:0:7050:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb393e873fab64283 00000100:00080000:1.0:1782727667.062582:0:7050:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782727667.062587:0:7050:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91fcf9e51800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1782727667.062627:0:7050:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91fcec54ea00 x1869325347596672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782727667.062656:0:7050:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1782727667.062732:0:7050:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727667.062736:0:7050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727667.062738:0:7050:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782727667.062741:0:7050:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727667.062747:0:7050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727667.062749:0:7050:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727667.062751:0:7050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727667.062754:0:7050:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1782727667.062789:0:7050:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:7050:1869325347596800:0@lo:502: 00000100:00100000:1.0:1782727667.062902:0:7050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727667.062976:0:7050:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0618cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727667.064210:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3441:1869325347596672:0@lo:8: 00000100:00100000:3.0:1782727667.064290:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727667.064440:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727667.064449:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347597056:0@lo:400: 00000100:00100000:3.0:1782727667.064498:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727667.064557:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347597056 00000100:00100000:3.0:1782727667.064567:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347597056 00000100:00100000:3.0:1782727667.064623:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727667.064634:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347597056:12345-0@lo:400: 00000100:00100000:3.0:1782727667.064708:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347597056:12345-0@lo:400: Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727667.064716:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782727667.064778:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcf3a67100 x1869325347597056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727667.064794:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347597056:0@lo:400: 00000100:00100000:1.0:1782727667.064910:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347596672 00000100:00100000:1.0:1782727667.064923:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347596672 00000100:00100000:1.0:1782727667.064966:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727667.064972:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3441:x1869325347596672:12345-0@lo:8: 00010000:00080000:1.0:1782727667.065005:0:6938:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:1.0:1782727667.065051:0:6938:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb393e873fab6428a 00002000:00100000:1.0:1782727667.065109:0:6938:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91fcfde9d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1782727667.065114:0:6938:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1782727667.065119:0:6938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1782727667.065223:0:6938:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782727667.065519:0:6938:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782727667.065548:0:6938:0:(import.c:65:import_set_state_nolock()) ffff91fcfde9d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727667.065599:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3441:x1869325347596672:12345-0@lo:8: Request processed in 626us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727667.065605:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1782727667.065628:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782727667.065654:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54ea00 x1869325347596672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782727677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727667.065664:0:3441:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782727667.065674:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782727667.065686:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782727667.065691:0:3441:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1782727667.065694:0:3441:0:(import.c:65:import_set_state_nolock()) ffff91fcf9e51800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782727667.065703:0:3441:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782727667.065708:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3441:1869325347596672:0@lo:8: 00000004:00080000:3.0:1782727667.065850:0:7054:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782727667.065892:0:7054:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173950467893ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782727667.065898:0:7054:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1782727667.066451:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347596928:0@lo:400: 00000100:00100000:0.0:1782727667.066861:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727667.067738:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347596928 00000100:00100000:1.0:1782727667.067749:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347596928 00000100:00100000:1.0:1782727667.067797:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727667.067816:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347596928:12345-0@lo:400: 00000100:00100000:1.0:1782727667.067885:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347596928:12345-0@lo:400: Request processed in 71us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727667.067892:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727667.068655:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347596800 00000100:00100000:2.0:1782727667.068663:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347596800 00000100:00100000:2.0:1782727667.068703:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782727667.068711:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce0b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:7050:x1869325347596800:12345-0@lo:502: 00000100:00100000:2.0:1782727667.068836:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce0b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:7050:x1869325347596800:12345-0@lo:502: Request processed in 126us (5934us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727667.068843:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782727667.069260:0:7050:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:7050:1869325347596800:0@lo:502: 00000020:01000000:3.0:1782727667.069297:0:7050:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727667.069304:0:7050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727667.069306:0:7050:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782727667.069312:0:7050:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:1.0:1782727667.069574:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1782727667.069826:0:7055:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1782727667.069850:0:7055:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7055:1869325347597312:0@lo:7: 00000100:00100000:3.0:1782727667.069891:0:7055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727667.069928:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347597312 00000100:00100000:3.0:1782727667.069933:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347597312 00000100:00100000:3.0:1782727667.069977:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727667.069983:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7055:x1869325347597312:12345-0@lo:7: 00010000:00080000:0.0:1782727667.073189:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcf3a65180 x1869325347596928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727667.073209:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347596928:0@lo:400: 00000100:00100000:0.0:1782727667.073253:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727667.073268:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347597184:0@lo:13: 00000100:00100000:0.0:1782727667.073351:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782727667.074679:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727667.074717:0:7055:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd2132540 going to sleep for 11 seconds 00000020:01000000:2.0:1782727667.074898:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1782727667.074947:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782727667.074962:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727667.074975:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727667.074986:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782727667.074989:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91fcf9dc33a0 from 1 10000000:01000000:2.0:1782727667.074992:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782727667.075047:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727667.075056:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727667.075081:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727667.075106:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347597440:0@lo:101: 00000100:00100000:2.0:1782727667.075163:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727667.075239:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fec480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727667.075266:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347597184 00000100:00100000:2.0:1782727667.075273:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347597184 00000100:00100000:2.0:1782727667.075316:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727667.075326:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1869325347597184:12345-0@lo:13: 00002000:00000024:2.0:1782727667.075359:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923824640 avail 3692302336 00000100:00100000:2.0:1782727667.075404:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1869325347597184:12345-0@lo:13: Request processed in 79us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727667.075412:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782727667.075483:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcf3a67100 x1869325347597184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727667.075639:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347597184:0@lo:13: 00002000:00080000:3.0:1782727667.078476:0:6940:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00000100:00100000:1.0:1782727667.078675:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347597440 00000100:00100000:1.0:1782727667.078686:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347597440 00000100:00100000:1.0:1782727667.078743:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782727667.078753:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce0b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347597440:12345-0@lo:101: 00010000:00010000:1.0:1782727667.078770:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727667.078788:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567b600/0xb393e873fab64298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64291 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727667.078815:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567b600/0xb393e873fab64298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64291 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727667.078827:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567b600/0xb393e873fab64298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64291 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727667.078836:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567b600, rc 0) 00000100:00100000:1.0:1782727667.078909:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce0b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347597440:12345-0@lo:101: Request processed in 158us (3747us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727667.078916:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00002000:00080000:3.0:1782727667.078976:0:6940:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1782727667.079140:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347597440:0@lo:101: 00010000:00010000:2.0:1782727667.079162:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727667.079172:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727667.079242:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347597568:0@lo:501: 00000100:00100000:2.0:1782727667.079288:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727667.079323:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fec480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727667.079340:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347597568 00000100:00100000:2.0:1782727667.079344:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347597568 00000100:00100000:2.0:1782727667.079370:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782727667.079376:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347597568:12345-0@lo:501: 00000100:00100000:2.0:1782727667.079461:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347597568:12345-0@lo:501: Request processed in 84us (172us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727667.079468:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782727667.079512:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347597568:0@lo:501: 10000000:01000000:2.0:1782727667.079539:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782727667.079545:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727667.079554:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727667.079619:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7055:x1869325347597312:12345-0@lo:7: Request processed in 9633us (9725us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727667.079628:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782727667.086894:0:7055:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcf3a65f80 x1869325347597312/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782727683 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727667.086915:0:7055:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7055:1869325347597312:0@lo:7: 00000004:00080000:1.0:1782727667.086929:0:7055:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1782727667.087640:0:7055:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a67800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7055:1869325347597696:0@lo:5: 00000100:00100000:3.0:1782727667.087702:0:7055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727667.087743:0:7055:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd2132840 going to sleep for 11 seconds 00000100:00100000:0.0:1782727667.088349:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347597696 00000100:00100000:0.0:1782727667.088357:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347597696 00000100:00100000:0.0:1782727667.088452:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782727667.088461:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7055:x1869325347597696:12345-0@lo:5: 00002000:00080000:0.0:1782727667.088562:0:6939:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1782727667.088567:0:6939:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1782727667.092517:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1782727667.092535:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1782727667.092761:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7055:x1869325347597696:12345-0@lo:5: Request processed in 4297us (5054us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782727667.092772:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782727667.092875:0:7055:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcf3a67800 x1869325347597696/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727683 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727667.092887:0:7055:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1782727667.092894:0:7055:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a67800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7055:1869325347597696:0@lo:5: 00000004:00080000:3.0:1782727667.092909:0:7055:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1782727667.092955:0:7055:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a67800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7055:1869325347597824:0@lo:700: 00000100:00100000:3.0:1782727667.092989:0:7055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727667.093045:0:7055:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd2132840 going to sleep for 11 seconds 00000100:00100000:0.0:1782727667.093102:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347597824 00000100:00100000:0.0:1782727667.093109:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347597824 00000100:00100000:0.0:1782727667.093154:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727667.093163:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7055:x1869325347597824:12345-0@lo:700: 00000100:00100000:0.0:1782727667.093197:0:6946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6946:1869325347597952:0@lo:700: 00000100:00100000:0.0:1782727667.093236:0:6946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727667.093252:0:6946:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc53b7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727667.093308:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347597952 00000100:00100000:3.0:1782727667.093312:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347597952 00000100:00100000:3.0:1782727667.093346:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727667.093353:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6946:x1869325347597952:12345-0@lo:700: 40000000:02000000:0.0:1782727667.119230:0:5958:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1782727667.133807:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6946:x1869325347597952:12345-0@lo:700: Request processed in 40442us (40557us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727667.133831:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782727667.134395:0:6946:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec5d0380 x1869325347597952/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782727683 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727667.134463:0:6946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6946:1869325347597952:0@lo:700: 40000000:02000000:1.0:1782727667.134483:0:6946:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1782727667.180673:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7055:x1869325347597824:12345-0@lo:700: Request processed in 87489us (87661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727667.180693:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782727667.180995:0:7055:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcf3a67800 x1869325347597824/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782727683 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727667.181022:0:7055:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a67800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7055:1869325347597824:0@lo:700: 00000004:02000040:1.0:1782727667.216372:0:7055:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1782727667.219529:0:7055:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7055:1869325347598080:0@lo:5: 00000100:00100000:1.0:1782727667.219623:0:7055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727667.219695:0:7055:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fccf7440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727667.220041:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347598080 00000100:00100000:3.0:1782727667.220053:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347598080 00000100:00100000:3.0:1782727667.220136:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727667.220146:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7055:x1869325347598080:12345-0@lo:5: 00002000:00080000:2.0:1782727667.223921:0:6940:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1782727667.223944:0:6940:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1782727667.239505:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7055:x1869325347598080:12345-0@lo:5: Request processed in 19349us (19872us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782727667.239525:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782727667.240567:0:7055:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54ea00 x1869325347598080/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727683 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727667.240585:0:7055:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7055:1869325347598080:0@lo:5: 00000004:00080000:1.0:1782727667.240598:0:7055:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1782727667.740940:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727668.764764:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727669.788070:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727670.816069:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727671.841648:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727672.289022:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347598208:0@lo:13: 00000100:00100000:1.0:1782727672.289122:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727672.290118:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727672.290135:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347598464:0@lo:400: 00000100:00100000:0.0:1782727672.290185:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727672.290218:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347598336:0@lo:400: 00000100:00100000:0.0:1782727672.290250:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727672.290288:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347598464 00000100:00100000:0.0:1782727672.290297:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347598464 00000100:00100000:0.0:1782727672.290359:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782727672.290370:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347598464:12345-0@lo:400: 00000100:00100000:0.0:1782727672.290441:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347598464:12345-0@lo:400: Request processed in 55us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727672.290450:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782727672.290510:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec5d1f80 x1869325347598464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727672.290527:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347598464:0@lo:400: 00000100:00100000:0.0:1782727672.290571:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347598592:0@lo:400: 00000100:00100000:0.0:1782727672.290595:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727672.290652:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347598592 00000100:00100000:0.0:1782727672.290657:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347598592 00000100:00100000:0.0:1782727672.290694:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782727672.290700:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347598592:12345-0@lo:400: 00000100:00100000:0.0:1782727672.290737:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347598592:12345-0@lo:400: Request processed in 37us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727672.290743:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1782727672.290761:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727672.290784:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec5d1f80 x1869325347598592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727672.290793:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347598592:0@lo:400: 00000100:00100000:2.0:1782727672.291094:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347598208 00000100:00100000:2.0:1782727672.291100:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347598208 00000100:00100000:2.0:1782727672.291146:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727672.291163:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869325347598208:12345-0@lo:13: 00002000:00000024:2.0:1782727672.291189:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727672.291239:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869325347598208:12345-0@lo:13: Request processed in 77us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727672.291245:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727672.291273:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347598336 00000100:00100000:2.0:1782727672.291277:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347598336 00000100:00100000:2.0:1782727672.291308:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782727672.291315:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3445:x1869325347598336:12345-0@lo:400: 00000100:00100000:2.0:1782727672.291353:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3445:x1869325347598336:12345-0@lo:400: Request processed in 39us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727672.291359:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1782727672.291406:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54f800 x1869325347598208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727672.291446:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347598208:0@lo:13: 00000100:00080000:0.0:1782727672.295057:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727672.295139:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347598336:0@lo:400: 00000001:02000400:0.0:1782727672.337994:0:7306:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782727672.859846:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782727673.317872:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000020:00000004:0.0:1782727673.598367:0:7358:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727673.598937:0:7358:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727673.892922:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727674.908094:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727675.937590:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727676.745190:0:7460:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727676.745399:0:7460:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727676.963857:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727677.404574:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347598720:0@lo:13: 00000100:00100000:3.0:1782727677.404648:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727677.404732:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347598720 00000100:00100000:0.0:1782727677.404740:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347598720 00000100:00100000:0.0:1782727677.404800:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782727677.404809:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727677.404809:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347598720:12345-0@lo:13: 00000100:00100000:1.0:1782727677.404816:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347598848:0@lo:400: 00002000:00000024:0.0:1782727677.404852:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727677.404859:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727677.404899:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347598720:12345-0@lo:13: Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727677.404907:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782727677.404935:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347599104:0@lo:400: 00010000:00080000:1.0:1782727677.404936:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54c000 x1869325347598720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727677.404946:0:3444:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1782727677.404960:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727677.404987:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727677.404992:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347598976:0@lo:400: 00000100:00100000:0.0:1782727677.405015:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727677.405041:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347599104 00000100:00100000:0.0:1782727677.405044:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347599104 00000100:00100000:0.0:1782727677.405071:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347598976 00000100:00100000:0.0:1782727677.405073:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347598976 00000100:00100000:0.0:1782727677.405087:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782727677.405093:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347599104:12345-0@lo:400: 00000100:00080000:3.0:1782727677.405115:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727677.405119:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727677.405130:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347599104:12345-0@lo:400: Request processed in 37us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727677.405136:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782727677.405147:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727677.405152:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347598976:12345-0@lo:400: 00000100:00100000:1.0:1782727677.405157:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347598720:0@lo:13: 00000100:00100000:0.0:1782727677.405178:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347598976:12345-0@lo:400: Request processed in 26us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727677.405184:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1782727677.405214:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54dc00 x1869325347598976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727677.405224:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347598976:0@lo:400: 00010000:00080000:0.0:1782727677.405233:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54f800 x1869325347599104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727677.405241:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347599104:0@lo:400: 00000100:00100000:2.0:1782727677.405242:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347598848 00000100:00100000:2.0:1782727677.405245:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347598848 00000100:00100000:2.0:1782727677.405287:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782727677.405294:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3444:x1869325347598848:12345-0@lo:400: 00000100:00100000:2.0:1782727677.405331:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3444:x1869325347598848:12345-0@lo:400: Request processed in 38us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727677.405338:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782727677.405515:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347598848:0@lo:400: 00000020:00000004:1.0:1782727677.735610:0:7508:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727677.735622:0:7508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1782727677.979698:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727679.011563:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727680.039833:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727681.052071:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727682.075833:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727682.523818:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727682.523841:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347599232:0@lo:13: 00000100:00100000:1.0:1782727682.523909:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727682.523982:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347599232 00000100:00100000:1.0:1782727682.523989:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347599232 00000100:00100000:1.0:1782727682.524040:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727682.524049:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347599232:12345-0@lo:13: 00002000:00000024:1.0:1782727682.524077:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727682.524117:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347599232:12345-0@lo:13: Request processed in 69us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727682.524125:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1782727682.524145:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782727682.524174:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54c380 x1869325347599232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727682.524193:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347599232:0@lo:13: 00000100:00100000:3.0:1782727682.524593:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347599616:0@lo:400: 00000100:00100000:3.0:1782727682.524626:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727682.524649:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727682.524655:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347599488:0@lo:400: 00000100:00100000:3.0:1782727682.524675:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727682.524699:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347599616 00000100:00100000:3.0:1782727682.524702:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347599616 00000100:00100000:3.0:1782727682.524734:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347599488 00000100:00100000:3.0:1782727682.524738:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347599488 00000100:00100000:3.0:1782727682.524767:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782727682.524774:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347599616:12345-0@lo:400: 00000100:00100000:3.0:1782727682.524814:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347599616:12345-0@lo:400: Request processed in 41us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727682.524820:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782727682.524833:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782727682.524839:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347599488:12345-0@lo:400: 00000100:00100000:3.0:1782727682.524862:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347599488:12345-0@lo:400: Request processed in 24us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727682.524868:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1782727682.524901:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcf3a67100 x1869325347599488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727682.524930:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347599488:0@lo:400: 00010000:00080000:3.0:1782727682.524942:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcf3a65180 x1869325347599616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727682.524950:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347599616:0@lo:400: 00000100:00100000:2.0:1782727682.525254:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727682.525267:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347599360:0@lo:400: 00000100:00100000:2.0:1782727682.525303:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782727682.525810:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727682.527135:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347599360 00000100:00100000:3.0:1782727682.527145:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347599360 00000100:00100000:3.0:1782727682.527220:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782727682.527229:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3444:x1869325347599360:12345-0@lo:400: 00000100:00100000:3.0:1782727682.527302:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3444:x1869325347599360:12345-0@lo:400: Request processed in 74us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727682.527309:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782727682.527365:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347599360:0@lo:400: 00010000:00010000:2.0:1782727683.102444:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727684.123653:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727685.168288:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727686.171781:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727687.205700:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727687.645370:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347599744:0@lo:13: 00000100:00100000:2.0:1782727687.645471:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727687.645546:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347599744 00000100:00100000:2.0:1782727687.645553:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347599744 00000100:00100000:2.0:1782727687.645606:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727687.645615:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347599744:12345-0@lo:13: 00002000:00000024:2.0:1782727687.645643:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727687.645696:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347599744:12345-0@lo:13: Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727687.645705:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1782727687.645726:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727687.645757:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcc33ebb80 x1869325347599744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727687.645774:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347599744:0@lo:13: 00000100:00100000:1.0:1782727687.653920:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347600128:0@lo:400: 00000100:00100000:1.0:1782727687.653986:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727687.654019:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727687.654026:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347600000:0@lo:400: 00000100:00100000:1.0:1782727687.654053:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727687.654081:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347600128 00000100:00100000:1.0:1782727687.654094:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347600128 00000100:00100000:1.0:1782727687.654140:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347600000 00000100:00100000:1.0:1782727687.654144:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347600000 00000100:00100000:1.0:1782727687.654161:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727687.654169:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347600128:12345-0@lo:400: 00000100:00100000:1.0:1782727687.654219:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347600128:12345-0@lo:400: Request processed in 51us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727687.654225:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727687.654241:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727687.654247:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347600000:12345-0@lo:400: 00000100:00100000:1.0:1782727687.654270:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347600000:12345-0@lo:400: Request processed in 24us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727687.654275:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1782727687.654313:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54ea00 x1869325347600000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727687.654327:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347600000:0@lo:400: 00010000:00080000:1.0:1782727687.654337:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54df80 x1869325347600128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727687.654345:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347600128:0@lo:400: 00000100:00100000:2.0:1782727687.654407:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347599872:0@lo:400: 00000100:00100000:2.0:1782727687.654469:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782727687.654515:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727687.654763:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347599872 00000100:00100000:1.0:1782727687.654768:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347599872 00000100:00100000:1.0:1782727687.654793:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782727687.654799:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3445:x1869325347599872:12345-0@lo:400: 00000100:00100000:1.0:1782727687.654833:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3445:x1869325347599872:12345-0@lo:400: Request processed in 34us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727687.654838:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782727687.654880:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347599872:0@lo:400: 00010000:00010000:3.0:1782727688.220671:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782727688.654496:0:8006:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782727688.654501:0:8006:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1782727688.654502:0:8006:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1782727688.654637:0:8006:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91fcfde9a000 00000020:01000004:1.0:1782727688.654664:0:8006:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1782727688.654677:0:8006:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782727688.654701:0:8006:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91fcf7cb33a0) 00000020:00000080:1.0:1782727688.654720:0:8006:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1782727688.716185:0:8006:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1782727688.716244:0:8006:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1782727688.771565:0:8006:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1782727688.771852:0:8006:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782727688.771866:0:8006:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782727688.771879:0:8006:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb393e873fab642a6 00000020:01000004:1.0:1782727688.771886:0:8006:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1782727688.771911:0:8006:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.108@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782727688.771915:0:8006:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782727688.771922:0:8006:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1782727688.771955:0:8006:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1782727688.771961:0:8006:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1782727688.824747:0:8006:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782727688.824782:0:8006:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.108@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1782727688.824786:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782727688.824791:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782727688.824792:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727688.824793:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727688.824794:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727688.824796:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727688.824797:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727688.824799:0:8006:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727688.824800:0:8006:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727688.824802:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727688.824803:0:8006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782727688.824806:0:8006:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1782727688.824808:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782727688.824810:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782727688.824811:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727688.824812:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727688.824813:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727688.824814:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727688.824815:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727688.824816:0:8006:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727688.824817:0:8006:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727688.824818:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727688.824819:0:8006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782727688.824842:0:8006:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782727688.824859:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347600256:0@lo:253: 00000100:00100000:0.0:1782727688.824925:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727688.824978:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc74919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727688.825578:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347600256 00000100:00100000:2.0:1782727688.825588:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347600256 00000100:00100000:2.0:1782727688.825664:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782727688.825685:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:8006:x1869325347600256:12345-0@lo:253: 20000000:01000000:2.0:1782727688.825720:0:5946:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782727688.825725:0:5946:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1782727688.825731:0:5946:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1782727688.825734:0:5946:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1782727688.825969:0:5946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727688.826109:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1782727688.826125:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1782727688.826144:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1782727688.826150:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1782727688.826163:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1782727688.826178:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1782727688.826260:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1782727688.826277:0:5946:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:2.0:1782727688.826279:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:2.0:1782727688.826293:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1782727688.826299:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782727688.826313:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1782727688.826318:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:2.0:1782727688.826332:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1782727688.826338:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782727688.826351:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1782727688.826367:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1782727688.826761:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1782727688.826773:0:5946:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:2.0:1782727688.826774:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:2.0:1782727688.826787:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1782727688.826793:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782727688.826804:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1782727688.826809:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:2.0:1782727688.826822:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1782727688.826836:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782727688.826850:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1782727688.826865:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1782727688.826879:0:5946:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782727688.826881:0:5946:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782727688.826885:0:5946:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782727688.826931:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782727688.826934:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782727688.833258:0:8012:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1782727688.833318:0:8012:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1782727688.833337:0:8012:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1782727688.833665:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1782727688.833692:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1782727688.833705:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1782727688.833718:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782727688.833720:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727688.834032:0:8013:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727688.834049:0:8013:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727688.834061:0:8013:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1782727688.834188:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1782727688.834205:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1782727688.834217:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1782727688.834224:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782727688.834226:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782727688.834549:0:8014:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1782727688.834573:0:8014:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1782727688.834586:0:8014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1782727688.834736:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1782727688.834755:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1782727688.834770:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1782727688.834780:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1782727688.834788:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782727688.835792:0:8015:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1782727688.835958:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1782727688.835982:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1782727688.835997:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1782727688.836014:0:5946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782727688.836034:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836054:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc0030400/0xb393e873fab641fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab641f7 expref: 16 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836063:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcf3a77600/0xb393e873fab64228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64221 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836070:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc567bc00/0xb393e873fab64252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab6424b expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836085:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc567a800/0xb393e873fab6426e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64267 expref: 16 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836092:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc567b600/0xb393e873fab64298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64291 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836101:0:5946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836140:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc567b600/0xb393e873fab64298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64291 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836154:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc567b600/0xb393e873fab64298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64291 expref: 16 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727688.836169:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347600384:0@lo:104: 00000100:00100000:2.0:1782727688.836230:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727688.836328:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc567a800/0xb393e873fab6426e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64267 expref: 16 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836337:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc567a800/0xb393e873fab6426e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64267 expref: 16 pid: 5945 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727688.836346:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347600512:0@lo:104: 00010000:00010000:2.0:1782727688.836374:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc567bc00/0xb393e873fab64252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab6424b expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836382:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc567bc00/0xb393e873fab64252 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab6424b expref: 16 pid: 5944 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727688.836402:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347600640:0@lo:104: 00010000:00010000:2.0:1782727688.836459:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcf3a77600/0xb393e873fab64228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64221 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836468:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcf3a77600/0xb393e873fab64228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64221 expref: 16 pid: 5944 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727688.836476:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33e9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347600768:0@lo:104: 00010000:00010000:2.0:1782727688.836510:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc0030400/0xb393e873fab641fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab641f7 expref: 16 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.836518:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc0030400/0xb393e873fab641fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab641f7 expref: 16 pid: 5945 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727688.836526:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ea680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347600896:0@lo:104: 00000100:00100000:2.0:1782727688.836539:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727688.841572:0:5934:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782727688.841620:0:5934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.841665:0:5934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.841675:0:5934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.841685:0:5934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.841699:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347600384 00000100:00100000:2.0:1782727688.841708:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347600384 00000100:00100000:2.0:1782727688.841746:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347600512 00000100:00100000:2.0:1782727688.841749:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347600512 00000100:00100000:2.0:1782727688.841760:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347600640 00000100:00100000:2.0:1782727688.841762:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347600640 00000100:00100000:2.0:1782727688.841769:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347600768 00000100:00100000:2.0:1782727688.841771:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347600768 00000100:00100000:2.0:1782727688.841798:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347600896 00000100:00100000:2.0:1782727688.841801:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347600896 00000100:00100000:2.0:1782727688.841814:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727688.841824:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce0854850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+7:5946:x1869325347600384:12345-0@lo:104: 00010000:00010000:2.0:1782727688.841844:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.841931:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727688.841938:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce0854850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+7:5946:x1869325347600384:12345-0@lo:104: Request processed in 116us (5707us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727688.841945:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727688.841996:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727688.842017:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+6:5946:x1869325347600512:12345-0@lo:104: 00010000:00010000:2.0:1782727688.842025:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.842059:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782727688.842064:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+6:5946:x1869325347600512:12345-0@lo:104: Request processed in 64us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727688.842071:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727688.842083:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727688.842090:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+5:5946:x1869325347600640:12345-0@lo:104: 00010000:00010000:2.0:1782727688.842098:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.842126:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782727688.842131:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+5:5946:x1869325347600640:12345-0@lo:104: Request processed in 43us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727688.842149:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727688.842161:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782727688.842166:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:5946:x1869325347600768:12345-0@lo:104: 00010000:00010000:2.0:1782727688.842174:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.842202:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1782727688.842207:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:5946:x1869325347600768:12345-0@lo:104: Request processed in 41us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727688.842212:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782727688.842223:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782727688.842229:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5946:x1869325347600896:12345-0@lo:104: 00010000:00010000:2.0:1782727688.842236:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.842261:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1782727688.842265:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5946:x1869325347600896:12345-0@lo:104: Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727688.842270:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1782727688.842667:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782727688.842676:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842684:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76800 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:3.0:1782727688.842688:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842697:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727688.842705:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727688.842711:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727688.842745:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842751:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727688.842768:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842775:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76800/0xb393e873fab64291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64298 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842787:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782727688.842790:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842796:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76000 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:3.0:1782727688.842805:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842812:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727688.842819:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727688.842824:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727688.842836:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842841:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727688.842846:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842853:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76000/0xb393e873fab64267 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6426e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842861:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782727688.842864:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842870:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc0031000 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:3.0:1782727688.842873:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842880:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727688.842896:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727688.842902:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727688.842914:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842920:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727688.842933:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842940:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab6424b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64252 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842948:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727688.842950:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842956:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567b000 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:3.0:1782727688.842958:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842964:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727688.842970:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727688.842975:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727688.842993:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.842999:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727688.843004:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843011:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc567b000/0xb393e873fab64221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64228 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843019:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727688.843022:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843027:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567a400 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:3.0:1782727688.843030:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843036:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727688.843041:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727688.843045:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727688.843056:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843062:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727688.843066:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843081:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc567a400/0xb393e873fab641f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab641fe expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843094:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727688.843096:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727688.843098:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727688.843124:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347601024:0@lo:103: 00000100:00100000:3.0:1782727688.843172:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727688.843215:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347601536:0@lo:103: 00000100:00100000:3.0:1782727688.843238:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727688.843257:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727688.843262:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347601152:0@lo:103: 00000100:00100000:3.0:1782727688.843294:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727688.843337:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347601280:0@lo:103: 00000100:00100000:3.0:1782727688.843360:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727688.843372:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727688.843377:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347601408:0@lo:103: 00000100:00100000:3.0:1782727688.843396:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727688.843420:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347601024 00000100:00100000:3.0:1782727688.843448:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347601024 00010000:00010000:3.0:1782727688.843473:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc567b600/0xb393e873fab64298 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64291 expref: 17 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727688.843489:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347601536 00000100:00100000:3.0:1782727688.843492:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347601536 00010000:00010000:3.0:1782727688.843502:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc0030400/0xb393e873fab641fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab641f7 expref: 18 pid: 5945 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727688.843526:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347601152 00000100:00100000:3.0:1782727688.843529:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347601152 00010000:00010000:3.0:1782727688.843540:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc567a800/0xb393e873fab6426e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64267 expref: 19 pid: 5945 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727688.843549:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347601280 00000100:00100000:3.0:1782727688.843551:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347601280 00010000:00010000:3.0:1782727688.843560:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc567bc00/0xb393e873fab64252 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab6424b expref: 20 pid: 5944 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727688.843569:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347601408 00000100:00100000:3.0:1782727688.843571:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347601408 00010000:00010000:3.0:1782727688.843580:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcf3a77600/0xb393e873fab64228 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64221 expref: 21 pid: 5944 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727688.843592:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782727688.843599:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+21:3444:x1869325347601024:12345-0@lo:103: 00010000:00010000:3.0:1782727688.843610:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727688.843615:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc567b600/0xb393e873fab64298 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64291 expref: 21 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843627:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc567b600/0xb393e873fab64298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64291 expref: 21 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843644:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727688.843690:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+21:3444:x1869325347601024:12345-0@lo:103: Request processed in 92us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727688.843696:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782727688.843712:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727688.843724:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+20:3444:x1869325347601536:12345-0@lo:103: 00010000:00010000:3.0:1782727688.843732:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727688.843736:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc0030400/0xb393e873fab641fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab641f7 expref: 20 pid: 5945 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843745:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc0030400/0xb393e873fab641fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab641f7 expref: 20 pid: 5945 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843754:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727688.843776:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+20:3444:x1869325347601536:12345-0@lo:103: Request processed in 52us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727688.843781:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727688.843794:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727688.843800:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347601152:12345-0@lo:103: 00010000:00010000:3.0:1782727688.843807:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727688.843811:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc567a800/0xb393e873fab6426e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64267 expref: 19 pid: 5945 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843819:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc567a800/0xb393e873fab6426e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64267 expref: 19 pid: 5945 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843827:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727688.843845:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347601152:12345-0@lo:103: Request processed in 46us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727688.843851:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727688.843862:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782727688.843867:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:3442:x1869325347601280:12345-0@lo:103: 00010000:00010000:3.0:1782727688.843874:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727688.843884:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc567bc00/0xb393e873fab64252 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab6424b expref: 18 pid: 5944 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843892:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc567bc00/0xb393e873fab64252 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab6424b expref: 18 pid: 5944 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843901:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727688.843928:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:3442:x1869325347601280:12345-0@lo:103: Request processed in 61us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727688.843934:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782727688.843946:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782727688.843952:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:3442:x1869325347601408:12345-0@lo:103: 00010000:00010000:3.0:1782727688.843959:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727688.843963:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcf3a77600/0xb393e873fab64228 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64221 expref: 17 pid: 5944 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843972:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcf3a77600/0xb393e873fab64228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64221 expref: 17 pid: 5944 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843983:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.843992:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844006:0:5937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844013:0:5937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844020:0:5937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844032:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844037:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76e00 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:3.0:1782727688.844041:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844047:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844055:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844063:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727688.844083:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:3442:x1869325347601408:12345-0@lo:103: Request processed in 132us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727688.844089:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782727688.844131:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347601408:0@lo:103: 00000100:00100000:3.0:1782727688.844139:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347601280:0@lo:103: 00000100:00100000:3.0:1782727688.844164:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347601152:0@lo:103: 00000100:00100000:3.0:1782727688.844171:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347601024:0@lo:103: 00000100:00100000:3.0:1782727688.844177:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347601536:0@lo:103: 00010000:00010000:3.0:1782727688.844198:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc567b600/0xb393e873fab64298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64291 expref: 16 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727688.844207:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347600384:0@lo:104: 00010000:00010000:3.0:1782727688.844225:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc567a800/0xb393e873fab6426e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64267 expref: 15 pid: 5945 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727688.844232:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347600512:0@lo:104: 00010000:00010000:3.0:1782727688.844240:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc567bc00/0xb393e873fab64252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab6424b expref: 14 pid: 5944 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727688.844246:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347600640:0@lo:104: 00010000:00010000:3.0:1782727688.844255:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcf3a77600/0xb393e873fab64228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64221 expref: 13 pid: 5944 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727688.844263:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33e9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347600768:0@lo:104: 00010000:00010000:3.0:1782727688.844270:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc0030400/0xb393e873fab641fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab641f7 expref: 12 pid: 5945 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727688.844278:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ea680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5946:1869325347600896:0@lo:104: 00010000:00010000:3.0:1782727688.844309:0:5946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844318:0:5946:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844324:0:5946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.844329:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab642ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782727688.844341:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1782727688.845046:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727688.859136:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:8006:x1869325347600256:12345-0@lo:253: Request processed in 33431us (34189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727688.859154:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782727688.859287:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347600256:0@lo:253: 10000000:01000000:0.0:1782727688.859305:0:8006:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782727688.859308:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782727688.859310:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782727688.859312:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727688.859313:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1782727688.859314:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727688.859316:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727688.859328:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727688.859331:0:8006:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782727688.859333:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727688.859349:0:8006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782727688.859369:0:8006:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91fcfde9a000 from lustre-OST0001 10000000:01000000:0.0:1782727688.859406:0:8006:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1782727688.859409:0:8006:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782727688.859417:0:8006:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91fcf9dc33a0 local copy 10000000:01000000:0.0:1782727688.859444:0:8006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782727688.859482:0:8006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727688.859493:0:8006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727688.859502:0:8006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727688.859519:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347601664:0@lo:101: 00000100:00100000:0.0:1782727688.859553:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727688.859589:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc7491780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727688.859668:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347601664 00000100:00100000:1.0:1782727688.859675:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347601664 00000100:00100000:1.0:1782727688.859726:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782727688.859735:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:8006:x1869325347601664:12345-0@lo:101: 00010000:00010000:1.0:1782727688.859747:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727688.859761:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567ba00/0xb393e873fab642bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab642b4 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727688.859784:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567ba00/0xb393e873fab642bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab642b4 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727688.859806:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567ba00/0xb393e873fab642bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab642b4 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727688.859816:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567ba00, rc 0) 00000100:00100000:1.0:1782727688.859858:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347601664:12345-0@lo:101: Request processed in 125us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727688.859864:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782727688.860267:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347601664:0@lo:101: 00010000:00010000:2.0:1782727688.860280:0:8006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.860290:0:8006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727688.860949:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347601792:0@lo:501: 00000100:00100000:2.0:1782727688.860992:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.861040:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538c300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727688.861102:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347601792 00000100:00100000:0.0:1782727688.861107:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347601792 00000100:00100000:0.0:1782727688.861243:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782727688.861253:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347601792:12345-0@lo:501: 00000100:00100000:0.0:1782727688.861337:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347601792:12345-0@lo:501: Request processed in 86us (345us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727688.861344:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782727688.862084:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347601792:0@lo:501: 10000000:01000000:2.0:1782727688.862103:0:8006:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782727688.862140:0:8006:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782727688.862147:0:8006:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.862155:0:8006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.862161:0:8006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.862184:0:8006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782727688.862210:0:8006:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91fcfde9a000 10000000:01000000:2.0:1782727688.862215:0:8006:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782727688.862221:0:8006:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782727688.862223:0:8006:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782727688.862229:0:8006:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1782727688.862231:0:8006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782727688.862256:0:8006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.862264:0:8006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.862288:0:8006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727688.862306:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347601920:0@lo:101: 00000100:00100000:2.0:1782727688.862356:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727688.862398:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727688.862404:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.862411:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc0031e00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:3.0:1782727688.862415:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.862446:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727688.862454:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727688.862459:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727688.862478:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.862484:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727688.862504:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.862511:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab642b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb393e873fab642bb expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.862523:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727688.862528:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727688.862529:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727688.862539:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347602048:0@lo:103: 00000100:00100000:3.0:1782727688.862570:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727688.862618:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347602048 00000100:00100000:3.0:1782727688.862633:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347602048 00000100:00100000:3.0:1782727688.862681:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727688.862688:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:3445:x1869325347602048:12345-0@lo:103: 00010000:00010000:3.0:1782727688.862699:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727688.862709:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc567ba00/0xb393e873fab642bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb393e873fab642b4 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727688.862722:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727688.862751:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:3445:x1869325347602048:12345-0@lo:103: Request processed in 62us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727688.862757:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727688.862786:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347602048:0@lo:103: 00000100:00100000:2.0:1782727688.865398:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538c900 going to sleep for 11 seconds 00000100:00100000:1.0:1782727688.865735:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347601920 00000100:00100000:1.0:1782727688.865743:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347601920 00000100:00100000:1.0:1782727688.865792:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782727688.865801:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:8006:x1869325347601920:12345-0@lo:101: 00010000:00010000:1.0:1782727688.865815:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727688.865835:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567a200/0xb393e873fab642c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab642c2 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727688.865865:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567a200/0xb393e873fab642c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab642c2 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727688.865877:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567a200/0xb393e873fab642c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab642c2 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727688.865888:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567a200, rc 0) 00000100:00100000:1.0:1782727688.865958:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347601920:12345-0@lo:101: Request processed in 158us (3601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727688.865965:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782727688.868312:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347601920:0@lo:101: 00010000:00010000:2.0:1782727688.868353:0:8006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.868366:0:8006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727688.868544:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602176:0@lo:501: 00000100:00100000:2.0:1782727688.868605:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.868663:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538c900 going to sleep for 11 seconds 00000100:00100000:1.0:1782727688.868998:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347602176 00000100:00100000:1.0:1782727688.869005:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347602176 00000100:00100000:1.0:1782727688.869044:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782727688.869070:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347602176:12345-0@lo:501: 00000100:00100000:1.0:1782727688.869289:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347602176:12345-0@lo:501: Request processed in 219us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727688.869297:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782727688.869617:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602176:0@lo:501: 00000100:00100000:2.0:1782727688.869663:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602304:0@lo:503: 00000100:00100000:2.0:1782727688.869709:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.869733:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538c900 going to sleep for 11 seconds 00000100:00100000:1.0:1782727688.869798:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347602304 00000100:00100000:1.0:1782727688.869802:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347602304 00000100:00100000:1.0:1782727688.869823:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782727688.869831:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347602304:12345-0@lo:503: 00000100:00100000:1.0:1782727688.869922:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347602304:12345-0@lo:503: Request processed in 91us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727688.869930:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782727688.871359:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602304:0@lo:503: 00000040:00080000:2.0:1782727688.871707:0:8006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782727688.871807:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602432:0@lo:502: 00000100:00100000:2.0:1782727688.871869:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.871909:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538c900 going to sleep for 11 seconds 00000100:00100000:1.0:1782727688.872187:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347602432 00000100:00100000:1.0:1782727688.872193:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347602432 00000100:00100000:1.0:1782727688.872223:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782727688.872230:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347602432:12345-0@lo:502: 00000100:00100000:1.0:1782727688.872331:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347602432:12345-0@lo:502: Request processed in 100us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727688.872339:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782727688.873376:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602432:0@lo:502: 00000040:00080000:2.0:1782727688.873658:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782727688.873688:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1782727688.873701:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1782727688.873714:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1782727688.873727:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1782727688.873740:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1782727688.873769:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602560:0@lo:502: 00000100:00100000:2.0:1782727688.873819:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.873852:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538c900 going to sleep for 11 seconds 00000100:00100000:0.0:1782727688.873978:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347602560 00000100:00100000:0.0:1782727688.873985:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347602560 00000100:00100000:0.0:1782727688.874027:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782727688.874034:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347602560:12345-0@lo:502: 00000100:00100000:0.0:1782727688.874140:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347602560:12345-0@lo:502: Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727688.874154:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782727688.874301:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602560:0@lo:502: 00000040:00080000:2.0:1782727688.874397:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1782727688.874406:0:8006:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1782727688.875204:0:8016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782727688.875213:0:8016:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1782727688.875219:0:8016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727688.875222:0:8016:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1782727688.875227:0:8016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782727688.875241:0:8016:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91fcf7cb4d70) 00000020:00000080:1.0:1782727688.875259:0:8016:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782727688.875264:0:8016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782727688.875473:0:8016:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91fcfde9a000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1782727688.875481:0:8016:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782727688.875499:0:8016:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb393e873fab642d7 00010000:00010000:1.0:1782727688.883682:0:8016:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1782727688.883996:0:8016:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1782727688.890200:0:8016:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1782727688.892257:0:8016:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1782727688.905375:0:8016:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1782727688.907776:0:8016:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1782727688.922973:0:8016:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1782727688.926983:0:8016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1782727688.926995:0:8016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727688.927002:0:8016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727688.927004:0:8016:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1782727688.927008:0:8016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727688.927012:0:8016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727688.927013:0:8016:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727688.927016:0:8016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727688.927018:0:8016:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782727688.927041:0:8016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727688.927044:0:8016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727688.927045:0:8016:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727688.927049:0:8016:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1782727688.928898:0:8006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1782727688.928935:0:8006:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782727688.928961:0:8006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.928974:0:8006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727688.928982:0:8006:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91fcfde9a000 from 1 10000000:01000000:2.0:1782727688.928985:0:8006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727688.929020:0:8006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.929035:0:8006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.929047:0:8006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727688.929070:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602688:0@lo:101: 00000100:00100000:2.0:1782727688.929143:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.929184:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347602688 00000100:00100000:2.0:1782727688.929191:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347602688 00000100:00100000:2.0:1782727688.929231:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782727688.929239:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8006:x1869325347602688:12345-0@lo:101: 00010000:00010000:2.0:1782727688.929253:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727688.929266:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcf3a77600/0xb393e873fab642e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab642de expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.929288:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a77600/0xb393e873fab642e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab642de expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.929298:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcf3a77600/0xb393e873fab642e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab642de expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.929320:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77600, rc 0) 00000100:00100000:2.0:1782727688.929353:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8006:x1869325347602688:12345-0@lo:101: Request processed in 113us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727688.929359:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782727688.929419:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727688.929464:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602688:0@lo:101: 00010000:00010000:2.0:1782727688.929483:0:8006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.929492:0:8006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727688.929577:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602816:0@lo:501: 00000100:00100000:2.0:1782727688.929603:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.929614:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727688.935126:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347602816 00000100:00100000:3.0:1782727688.935141:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347602816 00000100:00100000:3.0:1782727688.935214:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782727688.935223:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8006:x1869325347602816:12345-0@lo:501: 00000100:00100000:3.0:1782727688.935395:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8006:x1869325347602816:12345-0@lo:501: Request processed in 172us (5789us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727688.935403:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782727688.937603:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602816:0@lo:501: 00000100:00100000:2.0:1782727688.937673:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602944:0@lo:503: 00000100:00100000:2.0:1782727688.937742:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.937785:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727688.937833:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347602944 00000100:00100000:3.0:1782727688.937839:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347602944 00000100:00100000:3.0:1782727688.937888:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782727688.937897:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8006:x1869325347602944:12345-0@lo:503: 00000100:00100000:3.0:1782727688.938007:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8006:x1869325347602944:12345-0@lo:503: Request processed in 110us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727688.938014:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782727688.938057:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347602944:0@lo:503: 00000040:00080000:3.0:1782727688.938308:0:8006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782727688.938395:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603072:0@lo:502: 00000100:00100000:3.0:1782727688.938461:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727688.938486:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347603072 00000100:00100000:3.0:1782727688.938490:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347603072 00000100:00100000:3.0:1782727688.938513:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782727688.938520:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8006:x1869325347603072:12345-0@lo:502: 00000100:00100000:3.0:1782727688.938592:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8006:x1869325347603072:12345-0@lo:502: Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727688.938598:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782727688.938639:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0b2b000 going to sleep for 11 seconds 00000100:00100000:3.0:1782727688.938665:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603072:0@lo:502: 00000040:00080000:3.0:1782727688.938858:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1782727688.938884:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1782727688.938904:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603200:0@lo:502: 00000100:00100000:3.0:1782727688.938939:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727688.938959:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347603200 00000100:00100000:3.0:1782727688.938963:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347603200 00000100:00100000:3.0:1782727688.938983:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727688.938990:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8006:x1869325347603200:12345-0@lo:502: 00000100:00100000:3.0:1782727688.939048:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8006:x1869325347603200:12345-0@lo:502: Request processed in 58us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727688.939055:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727688.939081:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0b2b000 going to sleep for 11 seconds 00000100:00100000:3.0:1782727688.939091:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603200:0@lo:502: 00000040:00080000:3.0:1782727688.939124:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1782727688.939137:0:8006:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1782727688.945667:0:8020:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727688.945682:0:8020:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727688.945684:0:8020:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782727688.945691:0:8020:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91fcfde9a000 00000020:00000080:0.0:1782727688.945694:0:8020:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782727688.945707:0:8020:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727688.945710:0:8020:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727688.945711:0:8020:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782727688.945714:0:8020:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1782727688.945860:0:8006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782727688.945893:0:8006:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727688.945922:0:8006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727688.945934:0:8006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727688.945989:0:8006:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782727688.945992:0:8006:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91fcfde9a000 10000000:01000000:1.0:1782727688.945996:0:8006:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91fcfde9a000 10000000:01000000:1.0:1782727688.945999:0:8006:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727688.946005:0:8006:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91fcfde9a000 from 1 10000000:01000000:1.0:1782727688.946007:0:8006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727688.946047:0:8006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727688.946056:0:8006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727688.946067:0:8006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727688.946096:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603328:0@lo:101: 00000100:00100000:1.0:1782727688.946189:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727688.946248:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0abc300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727688.946692:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347603328 00000100:00100000:0.0:1782727688.946701:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347603328 00000100:00100000:0.0:1782727688.946746:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782727688.946755:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8006:x1869325347603328:12345-0@lo:101: 00010000:00010000:0.0:1782727688.946768:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727688.946780:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc0030200/0xb393e873fab642f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab642ec expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727688.946822:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc0030200/0xb393e873fab642f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab642ec expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727688.946833:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc0030200/0xb393e873fab642f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab642ec expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727688.946842:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0030200, rc 0) 00000100:00100000:0.0:1782727688.946884:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347603328:12345-0@lo:101: Request processed in 130us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727688.946890:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782727688.946986:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603328:0@lo:101: 00010000:00010000:1.0:1782727688.947011:0:8006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727688.947020:0:8006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727688.947107:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603456:0@lo:501: 00000100:00100000:1.0:1782727688.947149:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727688.947182:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0abc300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727688.947283:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347603456 00000100:00100000:0.0:1782727688.947287:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347603456 00000100:00100000:0.0:1782727688.947326:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782727688.947334:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347603456:12345-0@lo:501: 00000100:00100000:0.0:1782727688.947592:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347603456:12345-0@lo:501: Request processed in 258us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727688.947600:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782727688.947863:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603456:0@lo:501: 00000100:00100000:1.0:1782727688.947895:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603584:0@lo:503: 00000100:00100000:1.0:1782727688.947935:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727688.947959:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0abc300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727688.948010:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347603584 00000100:00100000:0.0:1782727688.948015:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347603584 00000100:00100000:0.0:1782727688.948044:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782727688.948051:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347603584:12345-0@lo:503: 00000100:00100000:0.0:1782727688.948224:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347603584:12345-0@lo:503: Request processed in 173us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727688.948232:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782727688.948302:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603584:0@lo:503: 00000040:00080000:1.0:1782727688.948946:0:8006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782727688.949015:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603712:0@lo:502: 00000100:00100000:1.0:1782727688.949062:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727688.949228:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc3303d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727688.954539:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347603712 00000100:00100000:0.0:1782727688.954555:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347603712 00000100:00100000:0.0:1782727688.954625:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782727688.954660:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347603712:12345-0@lo:502: 00000100:00100000:0.0:1782727688.955022:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347603712:12345-0@lo:502: Request processed in 362us (5957us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727688.955030:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782727688.957827:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603712:0@lo:502: 00000040:00080000:3.0:1782727688.958097:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1782727688.958777:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1782727688.958801:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1782727688.958817:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1782727688.958831:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1782727688.958843:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1782727688.958854:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1782727688.958868:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1782727688.958882:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1782727688.958897:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1782727688.958909:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1782727688.958921:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1782727688.958934:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1782727688.958947:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1782727688.958960:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1782727688.958971:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1782727688.958983:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1782727688.958996:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1782727688.959009:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1782727688.959022:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1782727688.959035:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1782727688.959050:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1782727688.959064:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1782727688.959081:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1782727688.959095:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1782727688.959109:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1782727688.959122:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1782727688.959581:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1782727688.959597:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782727688.959609:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1782727688.959641:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1782727688.959672:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1782727688.959686:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1782727688.959700:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1782727688.959712:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1782727688.959725:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1782727688.959737:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1782727688.959782:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603840:0@lo:502: 00000100:00100000:3.0:1782727688.959863:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727688.959960:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0b2b000 going to sleep for 11 seconds 00000100:00100000:1.0:1782727688.965957:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347603840 00000100:00100000:1.0:1782727688.965976:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347603840 00000100:00100000:1.0:1782727688.966095:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782727688.966108:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347603840:12345-0@lo:502: 00000100:00100000:3.0:1782727688.971586:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347603840:0@lo:502: 00000040:00080000:3.0:1782727688.971751:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1782727688.971767:0:8006:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000100:00100000:1.0:1782727688.976282:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347603840:12345-0@lo:502: Request processed in 10168us (16411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727688.976298:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000020:01000004:0.0:1782727688.980873:0:8021:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1782727688.980893:0:8021:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91fcf9d9b3a0) 00000020:00000080:0.0:1782727688.980918:0:8021:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1782727688.981154:0:8021:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91fcfde9a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1782727688.981159:0:8021:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91fcfde9a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1782727688.981162:0:8021:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91fcfde9a000 3 00010000:00080000:0.0:1782727688.981188:0:8021:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91fcc71dd000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.108@tcp at head 00010000:00010000:0.0:1782727688.983313:0:8021:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1782727688.983463:0:8021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1782727688.983509:0:8021:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782727688.983524:0:8021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb393e873fab64301 00000100:00080000:0.0:1782727688.983535:0:8021:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782727688.983540:0:8021:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91fcc71dd000 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1782727688.983577:0:8021:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91fcec5d2300 x1869325347603968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782727688.983603:0:8021:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782727688.986226:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3441:1869325347603968:0@lo:38: 00000100:00100000:1.0:1782727688.986356:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727688.986468:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347603968 00000100:00100000:1.0:1782727688.986476:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347603968 00000100:00100000:1.0:1782727688.986517:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727688.986525:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3441:x1869325347603968:12345-0@lo:38: 00010000:00080000:1.0:1782727688.986555:0:5952:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1782727688.986595:0:5952:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb393e873fab64308 00000004:00100000:1.0:1782727688.986611:0:5952:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782727688.986656:0:5952:0:(import.c:65:import_set_state_nolock()) ffff91fcf7f29800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727688.986708:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1869325347603968:12345-0@lo:38: Request processed in 183us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727688.986716:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782727688.986773:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec5d2300 x1869325347603968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727688.986784:0:3441:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782727688.986792:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1782727688.986798:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782727688.986803:0:3441:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782727688.986805:0:3441:0:(import.c:65:import_set_state_nolock()) ffff91fcc71dd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782727688.986811:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3441:1869325347603968:0@lo:38: 00000100:00100000:1.0:1782727688.992946:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727688.992973:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347604096:0@lo:400: 00000100:00100000:1.0:1782727688.993057:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727688.993110:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347604096 00000100:00100000:1.0:1782727688.993120:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347604096 00000100:00100000:1.0:1782727688.993184:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727688.993194:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347604096:12345-0@lo:400: 00000100:00100000:1.0:1782727688.993262:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347604096:12345-0@lo:400: Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727688.993270:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1782727688.993331:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54ea00 x1869325347604096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727688.993347:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347604096:0@lo:400: 00000100:00100000:1.0:1782727688.993391:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347604224:0@lo:400: 00000100:00100000:1.0:1782727688.993417:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727688.993471:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347604224 00000100:00100000:1.0:1782727688.993476:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347604224 00000100:00100000:1.0:1782727688.993498:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782727688.993503:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347604224:12345-0@lo:400: 00000100:00100000:1.0:1782727688.993537:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347604224:12345-0@lo:400: Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727688.993542:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1782727688.993569:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54ea00 x1869325347604224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727688.993578:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347604224:0@lo:400: 00000100:00100000:1.0:1782727688.993611:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727688.993618:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347604352:0@lo:400: 00000100:00100000:1.0:1782727688.993657:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727688.993683:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347604352 00000100:00100000:1.0:1782727688.993687:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347604352 00000100:00100000:1.0:1782727688.993713:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727688.993719:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347604352:12345-0@lo:400: 00000100:00100000:1.0:1782727688.993764:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347604352:12345-0@lo:400: Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727688.993770:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782727688.993797:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54ea00 x1869325347604352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727688.993805:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347604352:0@lo:400: 00000040:00080000:3.0:1782727688.997789:0:8021:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1782727688.997958:0:8006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1782727688.998002:0:8006:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782727688.998030:0:8006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727688.998044:0:8006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782727688.998111:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782727688.998114:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782727688.998116:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782727688.998117:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782727688.998118:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782727688.998120:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782727688.998122:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782727688.998137:0:8006:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782727688.998138:0:8006:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782727688.998146:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782727688.998148:0:8006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782727688.998152:0:8006:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1782727688.998154:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782727688.998155:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782727688.998156:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782727688.998157:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782727688.998158:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782727688.998159:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782727688.998160:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782727688.998161:0:8006:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782727688.998162:0:8006:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782727688.998163:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782727688.998164:0:8006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782727688.998193:0:8006:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782727688.998217:0:8006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347604480:0@lo:253: 00000100:00100000:2.0:1782727688.998291:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727688.998566:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347604480 00000100:00100000:2.0:1782727688.998574:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347604480 00000100:00100000:2.0:1782727688.998615:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782727688.998623:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347604480:12345-0@lo:253: 20000000:01000000:2.0:1782727688.998779:0:5944:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1782727688.998792:0:5944:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1782727688.998930:0:8006:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727688.999047:0:8023:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8023:1869325347604608:0@lo:901: 00000100:00100000:1.0:1782727688.999082:0:8023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727688.999109:0:8023:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc3303c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727689.001479:0:5962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347604608 00000100:00100000:2.0:1782727689.001493:0:5962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347604608 00000100:00100000:2.0:1782727689.001551:0:5962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727689.001560:0:5962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8023:x1869325347604608:12345-0@lo:901: 00000100:00100000:2.0:1782727689.001704:0:5962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8023:x1869325347604608:12345-0@lo:901: Request processed in 145us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727689.001712:0:5962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782727689.001734:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782727689.001995:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91fcec54ea00 x1869325347604608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782727704 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727689.002010:0:8023:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8023:1869325347604608:0@lo:901: 20000000:01000000:0.0:1782727689.016011:0:5944:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782727689.016033:0:5944:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1782727689.016157:0:5967:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782727689.016174:0:5967:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782727689.016196:0:5967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727689.016215:0:5967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64260 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64259 expref: 14 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727689.016223:0:5967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727689.016259:0:5967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64259 expref: 14 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727689.016272:0:5967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64259 expref: 14 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727689.016286:0:5967:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33e8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5967:1869325347604736:0@lo:104: 00000100:00100000:2.0:1782727689.016361:0:5967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727689.016680:0:5967:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc538c300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727689.016953:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347604736 00000100:00100000:0.0:1782727689.016962:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347604736 00000100:00100000:2.0:1782727689.017339:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8006:x1869325347604480:12345-0@lo:253: Request processed in 18715us (19047us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727689.017349:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782727689.017492:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727689.017502:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5967:x1869325347604736:12345-0@lo:104: 00010000:00010000:0.0:1782727689.017516:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727689.017585:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727689.017591:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:5967:x1869325347604736:12345-0@lo:104: Request processed in 92us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727689.017598:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782727689.017921:0:5967:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33e8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5967:1869325347604736:0@lo:104: 00010000:00010000:2.0:1782727689.017941:0:5967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.020285:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727689.020299:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.020311:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567ae00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:1.0:1782727689.020315:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.020337:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727689.020346:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727689.020352:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727689.020671:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.020678:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727689.020702:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.020708:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc567ae00/0xb393e873fab64259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64260 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.020730:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727689.020732:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727689.020733:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727689.020750:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347604864:0@lo:103: 00000100:00100000:1.0:1782727689.020820:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727689.020900:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347604864 00000100:00100000:1.0:1782727689.020907:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347604864 00010000:00010000:1.0:1782727689.020936:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64259 expref: 14 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727689.020965:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727689.020972:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcde69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:3445:x1869325347604864:12345-0@lo:103: 00010000:00010000:1.0:1782727689.020987:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727689.020992:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64259 expref: 14 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.021003:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64259 expref: 14 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.021016:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64259 expref: 14 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.021037:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.021045:0:5936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782727689.021060:0:5936:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004887060s 00010000:00010000:1.0:1782727689.021065:0:5936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.021071:0:5936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.021094:0:5936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.021100:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.021105:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76000 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:1.0:1782727689.021109:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.021116:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727689.021447:0:8006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8006:1869325347604480:0@lo:253: 10000000:01000000:3.0:1782727689.021462:0:8006:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782727689.021465:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782727689.021467:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727689.021468:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727689.021469:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727689.021470:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727689.021472:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727689.021473:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727689.021475:0:8006:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727689.021477:0:8006:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727689.021478:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727689.021479:0:8006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782727689.021496:0:8006:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782727689.032049:0:8006:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1782727689.032568:0:8006:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1782727689.032779:0:8006:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1782727689.032939:0:8006:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00010000:00010000:2.0:1782727689.033732:0:5967:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727689.033745:0:5967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.034235:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.034248:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6430f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727689.034275:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00080000:10000000:3.0:1782727689.034595:0:8006:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1782727689.034933:0:8006:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1782727689.035939:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcde69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:3445:x1869325347604864:12345-0@lo:103: Request processed in 14960us (15112us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727689.035951:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782727689.040345:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347604864:0@lo:103: 00000001:00000004:1.0:1782727689.056168:0:8006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1782727689.081987:0:8006:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1782727689.081997:0:8006:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1782727689.082038:0:8006:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782727689.082082:0:8006:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782727689.082102:0:8006:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1782727689.082137:0:8006:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1782727689.083266:0:8006:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727689.089863:0:8006:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1782727689.275681:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782727690.312846:0:8076:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727690.313350:0:8076:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727690.334899:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727691.355842:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727692.380103:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727692.769685:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347604992:0@lo:13: 00000100:00100000:2.0:1782727692.769766:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727692.769921:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347604992 00000100:00100000:1.0:1782727692.769932:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347604992 00000100:00100000:1.0:1782727692.770010:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727692.770020:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347604992:12345-0@lo:13: 00002000:00000024:1.0:1782727692.770055:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1782727692.770131:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727692.778808:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347604992:12345-0@lo:13: Request processed in 8780us (9033us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727692.778823:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1782727692.779410:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcf7eece00 x1869325347604992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727692.779556:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347604992:0@lo:13: 00010000:00010000:3.0:1782727693.405765:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727694.312722:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347605248:0@lo:400: 00000100:00100000:0.0:1782727694.312778:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727694.312830:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727694.312834:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347605376:0@lo:400: 00000100:00100000:0.0:1782727694.312848:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727694.312876:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347605248 00000100:00100000:0.0:1782727694.312881:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347605248 00000100:00100000:0.0:1782727694.312913:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347605376 00000100:00100000:0.0:1782727694.312914:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347605376 00000100:00100000:0.0:1782727694.312932:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727694.312937:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347605248:12345-0@lo:400: 00000100:00100000:0.0:1782727694.312972:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347605248:12345-0@lo:400: Request processed in 35us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727694.312977:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727694.312989:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727694.312993:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347605376:12345-0@lo:400: 00000100:00100000:2.0:1782727694.313187:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347605120:0@lo:400: 00000100:00100000:2.0:1782727694.313213:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727694.313230:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347605632:0@lo:400: 00000100:00100000:2.0:1782727694.313256:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727694.313265:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727694.313268:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347605504:0@lo:400: 00000100:00100000:2.0:1782727694.313289:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727694.313314:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347605120 00000100:00100000:2.0:1782727694.313317:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347605120 00000100:00100000:2.0:1782727694.313336:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782727694.313340:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:3443:x1869325347605120:12345-0@lo:400: 00000100:00100000:2.0:1782727694.313362:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:3443:x1869325347605120:12345-0@lo:400: Request processed in 21us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727694.313365:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782727694.313401:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347605120:0@lo:400: 00000100:00100000:2.0:1782727694.313459:0:5951:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727694.313464:0:5951:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1782727694.313481:0:5953:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727694.313485:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347605632 00000100:00100000:2.0:1782727694.313488:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347605632 00000100:00100000:2.0:1782727694.313499:0:5953:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727694.313503:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727694.313506:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347605632:12345-0@lo:400: 00000100:00100000:2.0:1782727694.313537:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347605632:12345-0@lo:400: Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727694.313543:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1782727694.313655:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec5d1c00 x1869325347605376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727694.313664:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347605376:0@lo:400: 00010000:00080000:2.0:1782727694.313671:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec5d0e00 x1869325347605248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727694.313676:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347605248:0@lo:400: 00010000:00080000:2.0:1782727694.313692:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec5d2d80 x1869325347605632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727694.313697:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347605632:0@lo:400: 00000100:00100000:2.0:1782727694.313713:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347605504 00000100:00100000:2.0:1782727694.313716:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347605504 00000100:00100000:2.0:1782727694.313734:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727694.313738:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347605504:12345-0@lo:400: 00000100:00100000:2.0:1782727694.313763:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347605504:12345-0@lo:400: Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727694.313767:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782727694.313782:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec5d2300 x1869325347605504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727694.313793:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347605504:0@lo:400: 00000100:00100000:0.0:1782727694.313972:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347605376:12345-0@lo:400: Request processed in 14us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727694.313977:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1782727694.314230:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727694.314234:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727694.430200:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727695.464182:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727696.481670:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782727696.863754:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782727696.863762:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91fcf9d2c000 from 30 10000000:01000000:3.0:1782727696.863767:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782727696.863805:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.863816:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.863827:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727696.863850:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347605760:0@lo:101: 00000100:00100000:3.0:1782727696.863910:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727696.864058:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc7492900 going to sleep for 11 seconds 00000100:00100000:3.0:1782727696.869463:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347605760 00000100:00100000:3.0:1782727696.869476:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347605760 00000100:00100000:3.0:1782727696.869535:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782727696.869545:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347605760:12345-0@lo:101: 00010000:00010000:3.0:1782727696.869572:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727696.869590:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcd346d800/0xb393e873fab6431d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64316 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.869616:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcd346d800/0xb393e873fab6431d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64316 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.869627:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcd346d800/0xb393e873fab6431d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64316 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.869636:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346d800, rc 0) 00000100:00100000:3.0:1782727696.869703:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347605760:12345-0@lo:101: Request processed in 160us (5793us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727696.869710:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782727696.869759:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347605760:0@lo:101: 00010000:00010000:3.0:1782727696.869777:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.869786:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727696.869861:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347605888:0@lo:501: 00000100:00100000:3.0:1782727696.869892:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727696.869926:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc7492900 going to sleep for 11 seconds 00000100:00100000:2.0:1782727696.870450:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347605888 00000100:00100000:2.0:1782727696.870456:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347605888 00000100:00100000:2.0:1782727696.870487:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782727696.870494:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347605888:12345-0@lo:501: 00000100:00100000:2.0:1782727696.870627:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347605888:12345-0@lo:501: Request processed in 133us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727696.870634:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782727696.871670:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347605888:0@lo:501: 00000100:00100000:0.0:1782727696.871715:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347606016:0@lo:503: 00000100:00100000:0.0:1782727696.871771:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.871845:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727696.877147:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347606016 00000100:00100000:3.0:1782727696.877158:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347606016 00000100:00100000:3.0:1782727696.877216:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782727696.877227:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347606016:12345-0@lo:503: 00000100:00100000:3.0:1782727696.877388:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347606016:12345-0@lo:503: Request processed in 163us (5616us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727696.877396:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782727696.877569:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347606016:0@lo:503: 00000100:00100000:0.0:1782727696.885386:0:8354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8354:1869325347606144:0@lo:502: 00000100:00100000:0.0:1782727696.885491:0:8354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.885546:0:8354:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727696.885610:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347606144 00000100:00100000:3.0:1782727696.885617:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347606144 00000100:00100000:3.0:1782727696.885669:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782727696.885679:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8354:x1869325347606144:12345-0@lo:502: 00000100:00100000:3.0:1782727696.885800:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8354:x1869325347606144:12345-0@lo:502: Request processed in 123us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727696.885808:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782727696.885953:0:8354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8354:1869325347606144:0@lo:502: 00000100:00100000:0.0:1782727696.886126:0:8354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8354:1869325347606272:0@lo:502: 00000100:00100000:0.0:1782727696.886161:0:8354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.886195:0:8354:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727696.886237:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347606272 00000100:00100000:2.0:1782727696.886241:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347606272 00000100:00100000:2.0:1782727696.886308:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782727696.886315:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8354:x1869325347606272:12345-0@lo:502: 00000100:00100000:2.0:1782727696.886396:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8354:x1869325347606272:12345-0@lo:502: Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727696.886403:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782727696.887117:0:8354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8354:1869325347606272:0@lo:502: 00000040:00080000:0.0:1782727696.887142:0:8354:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1782727696.887205:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1782727696.887229:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727696.887239:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.887250:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727696.887259:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1782727696.887262:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1782727696.887265:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782727696.887294:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.887303:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.887320:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727696.887335:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347606400:0@lo:101: 00000100:00100000:0.0:1782727696.887368:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.888925:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727696.889108:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347606400 00000100:00100000:3.0:1782727696.889115:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347606400 00000100:00100000:3.0:1782727696.889150:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782727696.889158:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347606400:12345-0@lo:101: 00010000:00010000:3.0:1782727696.889170:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727696.889184:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcd346c400/0xb393e873fab6432b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64324 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.889207:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcd346c400/0xb393e873fab6432b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64324 expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.889218:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcd346c400/0xb393e873fab6432b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64324 expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.889226:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346c400, rc 0) 00000100:00100000:3.0:1782727696.889279:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347606400:12345-0@lo:101: Request processed in 122us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727696.889286:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782727696.890554:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347606400:0@lo:101: 00010000:00010000:0.0:1782727696.890575:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.890586:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727696.890658:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347606528:0@lo:501: 00000100:00100000:0.0:1782727696.890701:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.890743:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727696.890802:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347606528 00000100:00100000:2.0:1782727696.890808:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347606528 00000100:00100000:2.0:1782727696.890841:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782727696.890850:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347606528:12345-0@lo:501: 00000100:00100000:2.0:1782727696.890987:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347606528:12345-0@lo:501: Request processed in 137us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727696.891111:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782727696.891196:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347606528:0@lo:501: 00000100:00100000:0.0:1782727696.891222:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347606656:0@lo:503: 00000100:00100000:0.0:1782727696.891257:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.891281:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727696.891322:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347606656 00000100:00100000:2.0:1782727696.891326:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347606656 00000100:00100000:2.0:1782727696.891352:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782727696.891358:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347606656:12345-0@lo:503: 00000100:00100000:2.0:1782727696.891645:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347606656:12345-0@lo:503: Request processed in 287us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727696.891652:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782727696.892126:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347606656:0@lo:503: 00000100:00100000:0.0:1782727696.898314:0:8355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8355:1869325347606784:0@lo:502: 00000100:00100000:0.0:1782727696.898397:0:8355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.898468:0:8355:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727696.898610:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347606784 00000100:00100000:1.0:1782727696.898618:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347606784 00000100:00100000:1.0:1782727696.898665:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782727696.898675:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:8355:x1869325347606784:12345-0@lo:502: 00000100:00100000:1.0:1782727696.898793:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:8355:x1869325347606784:12345-0@lo:502: Request processed in 119us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727696.898810:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782727696.900141:0:8355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8355:1869325347606784:0@lo:502: 00000020:01000000:0.0:1782727696.900185:0:8355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727696.900195:0:8355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727696.900197:0:8355:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727696.900201:0:8355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727696.900204:0:8355:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782727696.900229:0:8355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8355:1869325347606912:0@lo:502: 00000100:00100000:0.0:1782727696.900282:0:8355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.900322:0:8355:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727696.900389:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347606912 00000100:00100000:1.0:1782727696.900395:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347606912 00000100:00100000:1.0:1782727696.900451:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782727696.900459:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:8355:x1869325347606912:12345-0@lo:502: 00000100:00100000:1.0:1782727696.900558:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:8355:x1869325347606912:12345-0@lo:502: Request processed in 100us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727696.900565:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782727696.900827:0:8355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8355:1869325347606912:0@lo:502: 00000020:01000000:0.0:1782727696.900845:0:8355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727696.900849:0:8355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727696.900851:0:8355:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727696.900855:0:8355:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1782727696.904569:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1782727696.904612:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782727696.904627:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.904639:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727696.909267:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782727696.909275:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91fcc90cc800 from 30 10000000:01000000:1.0:1782727696.909281:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727696.909321:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727696.909333:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727696.909344:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727696.909368:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607040:0@lo:101: 00000100:00100000:1.0:1782727696.910130:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727696.910222:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc914bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727696.912400:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347607040 00000100:00100000:0.0:1782727696.912412:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347607040 00000100:00100000:0.0:1782727696.912558:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782727696.912568:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347607040:12345-0@lo:101: 00010000:00010000:0.0:1782727696.912584:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727696.912600:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64339 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64332 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.912626:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64332 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.912637:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64332 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.912647:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0031c00, rc 0) 00000100:00100000:0.0:1782727696.912713:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347607040:12345-0@lo:101: Request processed in 147us (2585us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727696.912729:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782727696.912816:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607040:0@lo:101: 00010000:00010000:1.0:1782727696.912834:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727696.912843:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727696.912918:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607168:0@lo:501: 00000100:00100000:1.0:1782727696.912951:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727696.914627:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc914bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727696.914910:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347607168 00000100:00100000:3.0:1782727696.914919:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347607168 00000100:00100000:3.0:1782727696.914958:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782727696.915082:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347607168:12345-0@lo:501: 00000100:00100000:3.0:1782727696.915229:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347607168:12345-0@lo:501: Request processed in 263us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727696.915236:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782727696.915322:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607168:0@lo:501: 00000100:00100000:1.0:1782727696.915360:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607296:0@lo:503: 00000100:00100000:1.0:1782727696.915400:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727696.915439:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc914bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727696.915483:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347607296 00000100:00100000:0.0:1782727696.915487:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347607296 00000100:00100000:0.0:1782727696.915522:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782727696.915530:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347607296:12345-0@lo:503: 00000100:00100000:0.0:1782727696.915612:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347607296:12345-0@lo:503: Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727696.915618:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782727696.916128:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607296:0@lo:503: 00000100:00100000:3.0:1782727696.917932:0:8361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8361:1869325347607424:0@lo:502: 00000100:00100000:3.0:1782727696.918117:0:8361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727696.918158:0:8361:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727696.918219:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347607424 00000100:00100000:0.0:1782727696.918227:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347607424 00000100:00100000:0.0:1782727696.918312:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782727696.918322:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:8361:x1869325347607424:12345-0@lo:502: 00000100:00100000:0.0:1782727696.918468:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:8361:x1869325347607424:12345-0@lo:502: Request processed in 147us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727696.918476:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782727696.918594:0:8361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8361:1869325347607424:0@lo:502: 00000100:00100000:1.0:1782727696.918639:0:8361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8361:1869325347607552:0@lo:502: 00000100:00100000:1.0:1782727696.918669:0:8361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727696.922189:0:8361:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc914bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727696.922267:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347607552 00000100:00100000:3.0:1782727696.922276:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347607552 00000100:00100000:3.0:1782727696.922322:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782727696.922332:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:8361:x1869325347607552:12345-0@lo:502: 00000100:00100000:3.0:1782727696.922500:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:8361:x1869325347607552:12345-0@lo:502: Request processed in 168us (3828us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727696.922508:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782727696.922658:0:8361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8361:1869325347607552:0@lo:502: 00000040:00080000:1.0:1782727696.922693:0:8361:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1782727696.922840:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1782727696.922860:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727696.922872:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.922890:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727696.922901:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782727696.922903:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91fcc90cc800 from 5 10000000:01000000:3.0:1782727696.922906:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782727696.923203:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346c000/0xb393e873fab64340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.923213:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcd346c000/0xb393e873fab64340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.923223:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcd346c000/0xb393e873fab64340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727696.923241:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607680:0@lo:101: 00000100:00100000:3.0:1782727696.923279:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727696.923315:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727696.923372:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347607680 00000100:00100000:1.0:1782727696.923377:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347607680 00000100:00100000:1.0:1782727696.923402:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782727696.923408:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347607680:12345-0@lo:101: 00010000:00010000:1.0:1782727696.923417:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727696.923458:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567a400/0xb393e873fab64347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64340 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727696.923479:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567a400/0xb393e873fab64347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64340 expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727696.923495:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567a400/0xb393e873fab64347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64340 expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727696.923503:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567a400, rc 0) 00000100:00100000:1.0:1782727696.923547:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347607680:12345-0@lo:101: Request processed in 139us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727696.923554:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782727696.923635:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607680:0@lo:101: 00010000:00010000:3.0:1782727696.923648:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcd346c000/0xb393e873fab64340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64347 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.923657:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcd346c000/0xb393e873fab64340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64347 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727696.923702:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607808:0@lo:256: 00000100:00100000:3.0:1782727696.923731:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727696.923794:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727696.923914:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347607808 00000100:00100000:0.0:1782727696.923919:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347607808 00000100:00100000:2.0:1782727696.925877:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782727696.925895:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347607808:12345-0@lo:256: 20000000:01000000:2.0:1782727696.925925:0:5945:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782727696.925947:0:5945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782727696.925950:0:5945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1782727696.926084:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347607808:12345-0@lo:256: Request processed in 195us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727696.926092:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782727696.926280:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607808:0@lo:256: 10000000:01000000:3.0:1782727696.926332:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782727696.926342:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346c000/0xb393e873fab64340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64347 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.926353:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcd346c000/0xb393e873fab64340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64347 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727696.926362:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782727696.926364:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1782727696.926367:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727696.926395:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.926404:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.926413:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727696.926447:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607936:0@lo:101: 00000100:00100000:3.0:1782727696.926480:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727696.926728:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727696.927160:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347607936 00000100:00100000:1.0:1782727696.927168:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347607936 00000100:00100000:1.0:1782727696.927202:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782727696.927209:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347607936:12345-0@lo:101: 00010000:00010000:1.0:1782727696.927219:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727696.927233:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567b000/0xb393e873fab64355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab6434e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727696.927254:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567b000/0xb393e873fab64355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab6434e expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727696.927264:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567b000/0xb393e873fab64355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab6434e expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727696.927272:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567b000, rc 0) 00000100:00100000:1.0:1782727696.927317:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347607936:12345-0@lo:101: Request processed in 108us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727696.927324:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782727696.927407:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347607936:0@lo:101: 00010000:00010000:3.0:1782727696.927442:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.927451:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727696.927527:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347608064:0@lo:501: 00000100:00100000:3.0:1782727696.927555:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727696.927572:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727696.927638:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347608064 00000100:00100000:1.0:1782727696.927642:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347608064 00000100:00100000:1.0:1782727696.927660:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782727696.927671:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347608064:12345-0@lo:501: 00000100:00100000:1.0:1782727696.927779:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347608064:12345-0@lo:501: Request processed in 108us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727696.927786:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782727696.927850:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347608064:0@lo:501: 00000100:00100000:3.0:1782727696.927874:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347608192:0@lo:503: 00000100:00100000:3.0:1782727696.927909:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727696.927938:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727696.928216:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347608192 00000100:00100000:1.0:1782727696.928221:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347608192 00000100:00100000:1.0:1782727696.928239:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782727696.928246:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347608192:12345-0@lo:503: 00000100:00100000:1.0:1782727696.928372:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347608192:12345-0@lo:503: Request processed in 126us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727696.928379:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782727696.931193:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347608192:0@lo:503: 00000100:00100000:3.0:1782727696.931635:0:8365:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8365:1869325347608320:0@lo:502: 00000100:00100000:3.0:1782727696.931703:0:8365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727696.931750:0:8365:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727696.931805:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347608320 00000100:00100000:0.0:1782727696.931812:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347608320 00000100:00100000:0.0:1782727696.931854:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782727696.931862:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:8365:x1869325347608320:12345-0@lo:502: 00000100:00100000:0.0:1782727696.932069:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:8365:x1869325347608320:12345-0@lo:502: Request processed in 129us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727696.932078:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782727696.934713:0:8365:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8365:1869325347608320:0@lo:502: 00000020:01000000:3.0:1782727696.934762:0:8365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782727696.934770:0:8365:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1782727696.934778:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727696.934780:0:8365:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1782727696.934786:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782727696.934790:0:8365:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.108@tcp to nid 0x20000c0a8c96c (192.168.201.108@tcp) 00000020:01000000:3.0:1782727696.934816:0:8365:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782727696.934819:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727696.934836:0:8365:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91fcf3acb3a0) 00000020:00000080:3.0:1782727696.934859:0:8365:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1782727696.934865:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782727696.934956:0:8365:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1782727696.934963:0:8365:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1782727696.935061:0:8365:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb393e873fab64363 00010000:00080000:3.0:1782727696.935093:0:8365:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91fcf9e53800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:3.0:1782727696.935327:0:8365:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1782727696.935497:0:8365:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1782727696.935509:0:8365:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782727696.935694:0:8365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727696.935839:0:8365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727696.935972:0:8365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1782727696.938413:0:8365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1782727696.939455:0:8368:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782727696.939460:0:8368:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782727696.947828:0:8365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782727696.947843:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782727696.947887:0:8365:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782727696.947917:0:8365:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb393e873fab6436a 00000100:00080000:0.0:1782727696.947929:0:8365:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782727696.947937:0:8365:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91fcf9e53800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1782727696.948084:0:8365:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91fcec5d0380 x1869325347608448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782727696.948114:0:8365:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1782727696.948214:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325347608704:0@lo:400: 00000100:00100000:0.0:1782727696.948276:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.948311:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727696.948317:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347608576:0@lo:400: 00000100:00100000:0.0:1782727696.948353:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.948381:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347608832:0@lo:400: 00000100:00100000:0.0:1782727696.948408:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.948472:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727696.948478:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347608960:0@lo:400: 00000100:00100000:0.0:1782727696.948504:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.948547:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347608704 00000100:00100000:0.0:1782727696.948554:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347608704 00000100:00100000:0.0:1782727696.948599:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347608576 00000100:00100000:0.0:1782727696.948602:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347608576 00000100:00100000:0.0:1782727696.948615:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347608960 00000100:00100000:0.0:1782727696.948618:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347608960 00000100:00100000:0.0:1782727696.948634:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727696.948642:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325347608704:12345-0@lo:400: 00000100:00100000:0.0:1782727696.948702:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325347608704:12345-0@lo:400: Request processed in 60us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727696.948710:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727696.948728:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727696.948741:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347608576:12345-0@lo:400: 00000100:00100000:0.0:1782727696.948783:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347608576:12345-0@lo:400: Request processed in 43us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727696.948789:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727696.948802:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782727696.948808:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347608960:12345-0@lo:400: 00000100:00100000:0.0:1782727696.948835:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347608960:12345-0@lo:400: Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727696.948841:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1782727696.948854:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727696.948879:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec5d1c00 x1869325347608960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727696.948891:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347608960:0@lo:400: 00010000:00080000:0.0:1782727696.948916:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec5d2300 x1869325347608576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727696.948925:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347608576:0@lo:400: 00010000:00080000:0.0:1782727696.948934:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec5d2d80 x1869325347608704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727696.948941:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325347608704:0@lo:400: 00000100:00100000:3.0:1782727696.949108:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3441:1869325347608448:0@lo:8: 00000100:00100000:3.0:1782727696.949141:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1782727696.949277:0:8365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727696.949283:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727696.949285:0:8365:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1782727696.949288:0:8365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727696.949292:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727696.949294:0:8365:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727696.949297:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727696.949303:0:8365:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782727696.949327:0:8365:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe399f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8365:1869325347609088:0@lo:502: 00000100:00100000:0.0:1782727696.949363:0:8365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727696.949476:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347608832 00000100:00100000:2.0:1782727696.949480:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347608832 00000100:00100000:2.0:1782727696.949523:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347608448 00000100:00100000:2.0:1782727696.949527:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347608448 00000100:00100000:2.0:1782727696.949540:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727696.949547:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347608832:12345-0@lo:400: 00000100:00100000:2.0:1782727696.949591:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347608832:12345-0@lo:400: Request processed in 45us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727696.949598:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727696.949614:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727696.949618:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3441:x1869325347608448:12345-0@lo:8: 00010000:00080000:2.0:1782727696.949643:0:6939:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1782727696.949674:0:6939:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb393e873fab64371 00002000:00100000:2.0:1782727696.949689:0:6939:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91fcf3af8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1782727696.949701:0:6939:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1782727696.949706:0:6939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1782727696.949775:0:6939:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1782727696.950110:0:8365:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff2180 going to sleep for 11 seconds 00002000:00080000:2.0:1782727696.950252:0:6939:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782727696.950275:0:6939:0:(import.c:65:import_set_state_nolock()) ffff91fcf3afc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727696.950326:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3441:x1869325347608448:12345-0@lo:8: Request processed in 705us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727696.950333:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1782727696.950563:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727696.950595:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec5d0e00 x1869325347608832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727696.950608:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347608832:0@lo:400: 00010000:00080000:0.0:1782727696.951155:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec5d0380 x1869325347608448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782727706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727696.951165:0:3441:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782727696.951172:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782727696.951179:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782727696.951183:0:3441:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782727696.951186:0:3441:0:(import.c:65:import_set_state_nolock()) ffff91fcf9e53800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782727696.951200:0:3441:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782727696.951205:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3441:1869325347608448:0@lo:8: 00000100:00100000:3.0:1782727696.953783:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347609088 00000100:00100000:3.0:1782727696.953796:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347609088 00000100:00100000:3.0:1782727696.953853:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782727696.953863:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:8365:x1869325347609088:12345-0@lo:502: 00000100:00100000:3.0:1782727696.954043:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:8365:x1869325347609088:12345-0@lo:502: Request processed in 181us (4678us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727696.954051:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000004:00080000:3.0:1782727696.954096:0:8368:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782727696.954160:0:8368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 203838735572ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782727696.954166:0:8368:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1782727696.954295:0:8365:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe399f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8365:1869325347609088:0@lo:502: 00000020:01000000:0.0:1782727696.954334:0:8365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727696.954342:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727696.954344:0:8365:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727696.954349:0:8365:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1782727696.954585:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782727696.954607:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782727696.954617:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.954628:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727696.954645:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782727696.954648:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91fcf9dc33a0 from 1 10000000:01000000:3.0:1782727696.954651:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727696.954679:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.954687:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727696.954697:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727696.954715:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347609216:0@lo:101: 00000100:00100000:3.0:1782727696.954751:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727696.954790:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce04a1240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727696.954833:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347609216 00000100:00100000:0.0:1782727696.954839:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347609216 00000100:00100000:0.0:1782727696.954875:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782727696.954882:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347609216:12345-0@lo:101: 00010000:00010000:0.0:1782727696.954891:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727696.954903:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc0030a00/0xb393e873fab6437f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64378 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.954925:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc0030a00/0xb393e873fab6437f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64378 expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.954949:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc0030a00/0xb393e873fab6437f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64378 expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.954957:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0030a00, rc 0) 00000100:00100000:0.0:1782727696.955006:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347609216:12345-0@lo:101: Request processed in 124us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727696.955011:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782727696.955043:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347609216:0@lo:101: 00010000:00010000:0.0:1782727696.955056:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.955065:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727696.955117:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347609344:0@lo:501: 00000100:00100000:0.0:1782727696.955142:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.955156:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727696.955168:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347609344 00000100:00100000:0.0:1782727696.955170:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347609344 00000100:00100000:0.0:1782727696.955191:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782727696.955198:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347609344:12345-0@lo:501: 00000100:00100000:0.0:1782727696.955267:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347609344:12345-0@lo:501: Request processed in 68us (123us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727696.955273:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782727696.955302:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347609344:0@lo:501: 10000000:01000000:0.0:1782727696.955323:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782727696.955334:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727696.955341:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727696.960499:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727696.960812:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347609472:0@lo:13: 00000100:00100000:0.0:1782727696.960879:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782727696.960926:0:8369:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1782727696.960950:0:8369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe39b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8369:1869325347609600:0@lo:7: 00000100:00100000:0.0:1782727696.960988:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.961020:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347609600 00000100:00100000:0.0:1782727696.961028:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347609600 00000100:00100000:0.0:1782727696.961088:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727696.961098:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8369:x1869325347609600:12345-0@lo:7: 00000100:00100000:3.0:1782727696.961831:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347609472 00000100:00100000:3.0:1782727696.961837:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347609472 00000100:00100000:3.0:1782727696.961873:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782727696.961881:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3445:x1869325347609472:12345-0@lo:13: 00002000:00000024:3.0:1782727696.961902:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:3.0:1782727696.961960:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3445:x1869325347609472:12345-0@lo:13: Request processed in 80us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727696.961981:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782727696.962025:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe399f80 x1869325347609472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727696.962046:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347609472:0@lo:13: 00000100:00080000:1.0:1782727696.963673:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727696.963691:0:8369:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff23c0 going to sleep for 11 seconds 00000004:00080000:3.0:1782727696.964196:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1782727696.967956:0:6939:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1782727696.967964:0:6939:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1782727696.968702:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8369:x1869325347609600:12345-0@lo:7: Request processed in 7601us (7708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727696.968712:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1782727696.970135:0:8369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe39b800 x1869325347609600/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782727712 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727696.970152:0:8369:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe39b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8369:1869325347609600:0@lo:7: 00000004:00080000:2.0:1782727696.970164:0:8369:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1782727696.970197:0:8369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8369:1869325347609728:0@lo:5: 00000100:00100000:2.0:1782727696.970233:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727696.970263:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347609728 00000100:00100000:2.0:1782727696.970269:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347609728 00000100:00100000:2.0:1782727696.970309:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727696.970317:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8369:x1869325347609728:12345-0@lo:5: 00002000:00080000:2.0:1782727696.970342:0:6940:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1782727696.970346:0:6940:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1782727696.973292:0:8369:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc3303240 going to sleep for 11 seconds 00000001:00080000:2.0:1782727696.973800:0:8008:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1782727696.973820:0:8008:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1782727696.973946:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8369:x1869325347609728:12345-0@lo:5: Request processed in 3625us (3707us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782727696.973957:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1782727696.974127:0:8369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcc33ea680 x1869325347609728/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727712 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727696.974139:0:8369:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1782727696.974146:0:8369:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8369:1869325347609728:0@lo:5: 00000004:00080000:2.0:1782727696.974160:0:8369:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1782727696.974204:0:8369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8369:1869325347609856:0@lo:700: 00000100:00100000:2.0:1782727696.974234:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727696.974254:0:8369:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc3303240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727696.977767:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347609856 00000100:00100000:0.0:1782727696.977783:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347609856 00000100:00100000:0.0:1782727696.977845:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727696.977855:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8369:x1869325347609856:12345-0@lo:700: 00000100:00100000:0.0:1782727696.977907:0:6946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe398000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6946:1869325347609984:0@lo:700: 00000100:00100000:0.0:1782727696.977962:0:6946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727696.978877:0:6946:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727696.978901:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347609984 00000100:00100000:0.0:1782727696.978907:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347609984 00000100:00100000:0.0:1782727696.978982:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727696.978998:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6946:x1869325347609984:12345-0@lo:700: 40000000:02000000:1.0:1782727696.989124:0:5958:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1782727697.000964:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6946:x1869325347609984:12345-0@lo:700: Request processed in 21966us (22992us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727697.000982:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782727697.001107:0:6946:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe398000 x1869325347609984/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782727712 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727697.001122:0:6946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe398000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6946:1869325347609984:0@lo:700: 40000000:02000000:2.0:1782727697.001133:0:6946:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:02000400:2.0:1782727697.017366:0:8373:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1782727697.031627:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8369:x1869325347609856:12345-0@lo:700: Request processed in 53764us (57382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727697.031648:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782727697.036327:0:8369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcc33ea680 x1869325347609856/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782727712 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727697.036345:0:8369:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8369:1869325347609856:0@lo:700: 00000004:02000040:2.0:1782727697.057371:0:8369:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1782727697.064203:0:8369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8369:1869325347610112:0@lo:5: 00000100:00100000:2.0:1782727697.064271:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727697.064378:0:8369:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc3303240 going to sleep for 11 seconds 00000100:00100000:3.0:1782727697.064415:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347610112 00000100:00100000:3.0:1782727697.065116:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347610112 00000100:00100000:3.0:1782727697.065173:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727697.065183:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8369:x1869325347610112:12345-0@lo:5: 00002000:00080000:3.0:1782727697.075845:0:6939:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1782727697.075867:0:6939:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1782727697.077847:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8369:x1869325347610112:12345-0@lo:5: Request processed in 12660us (13570us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782727697.077857:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1782727697.081939:0:8369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcc33ea680 x1869325347610112/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727713 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727697.081958:0:8369:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8369:1869325347610112:0@lo:5: 00000004:00080000:0.0:1782727697.081973:0:8369:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1782727697.502664:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727697.892797:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727697.892823:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347610240:0@lo:13: 00000100:00100000:3.0:1782727697.892901:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727697.892968:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347610240 00000100:00100000:3.0:1782727697.892987:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347610240 00000100:00100000:3.0:1782727697.893034:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727697.893042:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347610240:12345-0@lo:13: 00002000:00000024:3.0:1782727697.893072:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727697.893112:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347610240:12345-0@lo:13: Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727697.893119:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782727697.893156:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcf7eed880 x1869325347610240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727697.893173:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347610240:0@lo:13: 00000020:00000004:1.0:1782727697.979371:0:8425:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727697.980311:0:8425:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727698.529467:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782727698.973179:0:8008:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1782727699.549782:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727700.573190:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782727701.045251:0:8526:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727701.045654:0:8526:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782727701.595637:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727701.982462:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727701.982488:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347610368:0@lo:13: 00000100:00100000:2.0:1782727701.982562:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727701.982639:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347610368 00000100:00100000:2.0:1782727701.982647:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347610368 00000100:00100000:2.0:1782727701.982706:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727701.982716:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347610368:12345-0@lo:13: 00002000:00000024:2.0:1782727701.982746:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727701.982792:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347610368:12345-0@lo:13: Request processed in 77us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727701.982799:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1782727701.982820:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782727701.982856:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcc33ebb80 x1869325347610368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727701.982867:0:3443:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1782727701.982886:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347610368:0@lo:13: 00000100:00100000:1.0:1782727701.986265:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347610624:0@lo:400: 00000100:00100000:1.0:1782727701.986337:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727701.986374:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727701.986380:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347610752:0@lo:400: 00000100:00100000:1.0:1782727701.986413:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727701.986514:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347610496:0@lo:400: 00000100:00100000:2.0:1782727701.986548:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727701.986587:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347611008:0@lo:400: 00000100:00100000:2.0:1782727701.986607:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727701.986622:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727701.986627:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347610880:0@lo:400: 00000100:00100000:2.0:1782727701.986647:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727701.986674:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347610624 00000100:00100000:2.0:1782727701.986689:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347610624 00000100:00100000:2.0:1782727701.986733:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347610752 00000100:00100000:2.0:1782727701.986735:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347610752 00000100:00100000:2.0:1782727701.986751:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347611008 00000100:00100000:2.0:1782727701.986754:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347611008 00000100:00100000:2.0:1782727701.986767:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782727701.986774:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347610624:12345-0@lo:400: 00000100:00100000:2.0:1782727701.986821:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347610624:12345-0@lo:400: Request processed in 47us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727701.986827:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782727701.986842:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782727701.986847:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347610752:12345-0@lo:400: 00000100:00100000:2.0:1782727701.986869:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347610752:12345-0@lo:400: Request processed in 22us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727701.986875:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782727701.986886:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727701.986892:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347611008:12345-0@lo:400: 00000100:00100000:2.0:1782727701.986933:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347611008:12345-0@lo:400: Request processed in 40us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727701.986939:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727701.986957:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347610880 00000100:00100000:2.0:1782727701.986961:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347610880 00000100:00100000:2.0:1782727701.986987:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727701.986994:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347610880:12345-0@lo:400: 00000100:00100000:2.0:1782727701.987040:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347610880:12345-0@lo:400: Request processed in 46us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727701.987046:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782727701.987083:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec54ca80 x1869325347610752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727701.987101:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347610752:0@lo:400: 00010000:00080000:2.0:1782727701.987115:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec54fb80 x1869325347610624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727701.987123:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347610624:0@lo:400: 00000100:00080000:2.0:1782727701.987149:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782727701.987154:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782727701.987169:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec54ce00 x1869325347610880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727701.987178:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347610880:0@lo:400: 00010000:00080000:2.0:1782727701.987187:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec54ea00 x1869325347611008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727701.987194:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347611008:0@lo:400: 00000100:00100000:1.0:1782727701.987589:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347610496 00000100:00100000:1.0:1782727701.987595:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347610496 00000100:00100000:1.0:1782727701.987634:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782727701.987641:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347610496:12345-0@lo:400: 00000100:00100000:1.0:1782727701.987680:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347610496:12345-0@lo:400: Request processed in 40us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727701.987686:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782727701.987992:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347610496:0@lo:400: 00000020:00000004:3.0:1782727701.988115:0:8574:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727701.988124:0:8574:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1782727702.476574:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727702.476908:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329760384 00000100:00100000:2.0:1782727702.476921:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329760384 00000100:00100000:2.0:1782727702.476977:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 114 00000100:00100000:2.0:1782727702.476987:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2349:x1869325329760384:12345-192.168.201.8@tcp:250: 00010000:00080000:2.0:1782727702.477018:0:5945:0:(ldlm_lib.c:1434:target_handle_connect()) MGS: connection from c3a2b312-3952-4d62-a958-96e4c68c622a@192.168.201.8@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1782727702.477061:0:5945:0:(genops.c:1406:class_connect()) connect: client c3a2b312-3952-4d62-a958-96e4c68c622a, cookie 0xb393e873fab64386 00000100:00080000:2.0:1782727702.479637:0:5945:0:(import.c:65:import_set_state_nolock()) ffff91fcde80e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727702.479977:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+5:2349:x1869325329760384:12345-192.168.201.8@tcp:250: Request processed in 2988us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727702.479987:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 114 00000100:00100000:3.0:1782727702.498085:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727702.498379:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329760512 00000100:00100000:2.0:1782727702.498391:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329760512 00000100:00100000:2.0:1782727702.498501:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 115 00000100:00100000:2.0:1782727702.498513:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+5:5427:x1869325329760512:12345-192.168.201.8@tcp:101: 00010000:00010000:2.0:1782727702.498534:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727702.498559:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcf3a76600/0xb393e873fab6438d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488b34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727702.498592:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a76600/0xb393e873fab6438d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b34 expref: 6 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727702.498604:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcf3a76600/0xb393e873fab6438d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b34 expref: 6 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727702.498615:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a76600, rc 0) 00000100:00100000:2.0:1782727702.498700:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+6:5427:x1869325329760512:12345-192.168.201.8@tcp:101: Request processed in 190us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727702.498708:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 115 00000100:00100000:3.0:1782727702.502203:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727702.508149:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329760640 00000100:00100000:2.0:1782727702.508169:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329760640 00000100:00100000:0.0:1782727702.508343:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 116 00000100:00100000:0.0:1782727702.508357:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+6:5427:x1869325329760640:12345-192.168.201.8@tcp:501: 00000100:00100000:0.0:1782727702.508520:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+6:5427:x1869325329760640:12345-192.168.201.8@tcp:501: Request processed in 166us (6326us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727702.508528:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 116 00000100:00100000:3.0:1782727702.515065:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727702.515368:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329760768 00000100:00100000:1.0:1782727702.515381:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329760768 00000100:00100000:1.0:1782727702.515482:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 117 00000100:00100000:1.0:1782727702.515494:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+6:5427:x1869325329760768:12345-192.168.201.8@tcp:101: 00010000:00010000:1.0:1782727702.515513:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727702.515533:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567a600/0xb393e873fab64394 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488b3b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727702.515564:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567a600/0xb393e873fab64394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b3b expref: 7 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727702.515576:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567a600/0xb393e873fab64394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b3b expref: 7 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727702.515586:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567a600, rc 0) 00000100:00100000:1.0:1782727702.515647:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+7:5427:x1869325329760768:12345-192.168.201.8@tcp:101: Request processed in 155us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727702.515654:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 117 00000100:00100000:3.0:1782727702.518691:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727702.518976:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329760896 00000100:00100000:2.0:1782727702.518987:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329760896 00000100:00100000:2.0:1782727702.519064:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 118 00000100:00100000:2.0:1782727702.519075:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+7:5427:x1869325329760896:12345-192.168.201.8@tcp:501: 00000100:00100000:2.0:1782727702.519477:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+8:5427:x1869325329760896:12345-192.168.201.8@tcp:501: Request processed in 402us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727702.519486:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 118 00000100:00100000:3.0:1782727702.521506:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727702.521676:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329761024 00000100:00100000:0.0:1782727702.521686:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329761024 00000100:00100000:0.0:1782727702.521749:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 119 00000100:00100000:0.0:1782727702.521758:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+8:5427:x1869325329761024:12345-192.168.201.8@tcp:503: 00000100:00100000:0.0:1782727702.521911:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+8:5427:x1869325329761024:12345-192.168.201.8@tcp:503: Request processed in 153us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727702.521919:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 119 00000100:00100000:3.0:1782727702.525600:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727702.526643:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329761152 00000100:00100000:2.0:1782727702.526673:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329761152 00000100:00100000:2.0:1782727702.526748:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:2.0:1782727702.526759:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+8:5446:x1869325329761152:12345-192.168.201.8@tcp:502: 00000100:00100000:2.0:1782727702.526938:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+8:5446:x1869325329761152:12345-192.168.201.8@tcp:502: Request processed in 181us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727702.526947:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:3.0:1782727702.558081:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727702.558356:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329761280 00000100:00100000:1.0:1782727702.558381:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329761280 00000100:00100000:1.0:1782727702.558520:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 121 00000100:00100000:1.0:1782727702.558533:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+8:5446:x1869325329761280:12345-192.168.201.8@tcp:502: 00000100:00100000:1.0:1782727702.558712:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+8:5446:x1869325329761280:12345-192.168.201.8@tcp:502: Request processed in 180us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727702.558720:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 121 00000100:00100000:3.0:1782727702.571579:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727702.571772:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329761408 00000100:00100000:0.0:1782727702.571783:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329761408 00000100:00100000:0.0:1782727702.571844:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00100000:0.0:1782727702.571871:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+8:5427:x1869325329761408:12345-192.168.201.8@tcp:101: 00010000:00010000:0.0:1782727702.571891:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727702.571920:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc0030400/0xb393e873fab6439b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488b65 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727702.571950:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc0030400/0xb393e873fab6439b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b65 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727702.571962:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc0030400/0xb393e873fab6439b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b65 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727702.571972:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0030400, rc 0) 00000100:00100000:0.0:1782727702.572040:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5427:x1869325329761408:12345-192.168.201.8@tcp:101: Request processed in 171us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727702.572050:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00100000:3.0:1782727702.581664:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727702.586340:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329761536 00000100:00100000:2.0:1782727702.586358:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329761536 00000100:00100000:2.0:1782727702.586466:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 123 00000100:00100000:2.0:1782727702.586478:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5427:x1869325329761536:12345-192.168.201.8@tcp:256: 20000000:01000000:2.0:1782727702.586506:0:5945:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782727702.586537:0:5945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782727702.586541:0:5945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782727702.586544:0:5945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782727702.586547:0:5945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1782727702.589691:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5427:x1869325329761536:12345-192.168.201.8@tcp:256: Request processed in 3201us (8035us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727702.589706:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 123 00000100:00100000:3.0:1782727702.595198:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727702.598486:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329761664 00000100:00100000:1.0:1782727702.598508:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329761664 00000100:00100000:1.0:1782727702.598678:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:1.0:1782727702.598689:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5427:x1869325329761664:12345-192.168.201.8@tcp:101: 00010000:00010000:1.0:1782727702.598709:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727702.598726:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567be00/0xb393e873fab643a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488b6c expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727702.598768:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567be00/0xb393e873fab643a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b6c expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727702.598778:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567be00/0xb393e873fab643a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b6c expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727702.598787:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567be00, rc 0) 00000100:00100000:1.0:1782727702.598882:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5427:x1869325329761664:12345-192.168.201.8@tcp:101: Request processed in 195us (3696us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727702.598889:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:3.0:1782727702.602222:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727702.602690:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329761792 00000100:00100000:2.0:1782727702.602700:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329761792 00000100:00100000:2.0:1782727702.602761:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 125 00000100:00100000:2.0:1782727702.602774:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc2477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5427:x1869325329761792:12345-192.168.201.8@tcp:501: 00000100:00100000:2.0:1782727702.603119:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc2477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5427:x1869325329761792:12345-192.168.201.8@tcp:501: Request processed in 346us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727702.603128:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 125 00000100:00100000:3.0:1782727702.605205:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727702.606092:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329761920 00000100:00100000:2.0:1782727702.606106:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329761920 00000100:00100000:2.0:1782727702.606198:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 126 00000100:00100000:2.0:1782727702.606208:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce0b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5427:x1869325329761920:12345-192.168.201.8@tcp:503: 00000100:00100000:2.0:1782727702.606693:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce0b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5427:x1869325329761920:12345-192.168.201.8@tcp:503: Request processed in 484us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727702.606701:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 126 00000100:00100000:3.0:1782727702.610278:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727702.610838:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329762048 00000100:00100000:1.0:1782727702.610849:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329762048 00000100:00100000:1.0:1782727702.610920:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 127 00000100:00100000:1.0:1782727702.610931:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce0b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5450:x1869325329762048:12345-192.168.201.8@tcp:502: 00000100:00100000:1.0:1782727702.611111:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce0b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5450:x1869325329762048:12345-192.168.201.8@tcp:502: Request processed in 182us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727702.611267:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 127 00000100:00100000:3.0:1782727702.615503:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727702.616663:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329762176 00000100:00100000:2.0:1782727702.616677:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329762176 00000100:00100000:2.0:1782727702.616873:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 128 00000100:00100000:2.0:1782727702.616885:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5450:x1869325329762176:12345-192.168.201.8@tcp:502: 00000100:00100000:2.0:1782727702.617078:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5450:x1869325329762176:12345-192.168.201.8@tcp:502: Request processed in 194us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727702.617086:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 128 00010000:00010000:2.0:1782727702.619711:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727702.621679:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727702.622658:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329762304 00000100:00100000:2.0:1782727702.622675:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329762304 00000100:00100000:2.0:1782727702.622786:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:2.0:1782727702.622796:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1869325329762304:12345-192.168.201.8@tcp:38: 00010000:00080000:2.0:1782727702.622831:0:5953:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from 7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1782727702.622953:0:5953:0:(genops.c:1406:class_connect()) connect: client 7bd37c29-d4cd-43a2-9946-117a0c108d30, cookie 0xb393e873fab643a9 00000004:00100000:2.0:1782727702.622980:0:5953:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1782727702.622986:0:5953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1782727702.636860:0:5953:0:(import.c:65:import_set_state_nolock()) ffff91fcde80a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727702.637039:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2349:x1869325329762304:12345-192.168.201.8@tcp:38: Request processed in 14237us (15367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727702.637053:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:0.0:1782727703.003957:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727703.003990:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347611136:0@lo:13: 00000100:00100000:0.0:1782727703.004069:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727703.004169:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347611136 00000100:00100000:0.0:1782727703.004179:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347611136 00000100:00100000:0.0:1782727703.004236:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727703.004377:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347611136:12345-0@lo:13: 00002000:00000024:0.0:1782727703.004418:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727703.004492:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347611136:12345-0@lo:13: Request processed in 118us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727703.004500:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1782727703.004598:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe399c00 x1869325347611136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727703.004615:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347611136:0@lo:13: 00000100:00080000:2.0:1782727703.004688:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782727703.644112:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727703.649195:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727703.649285:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727703.649511:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329762560 00000100:00100000:1.0:1782727703.649529:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329762560 00000100:00100000:1.0:1782727703.649639:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329762432 00000100:00100000:1.0:1782727703.649643:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329762432 00000100:00100000:1.0:1782727703.649672:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:1.0:1782727703.649686:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:5427:x1869325329762560:12345-192.168.201.8@tcp:41: 00000004:00000024:1.0:1782727703.649759:0:8231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1782727703.649897:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:5427:x1869325329762560:12345-192.168.201.8@tcp:41: Request processed in 213us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727703.649908:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:1.0:1782727703.649930:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:1.0:1782727703.649937:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:0:x1869325329762432:12345-192.168.201.8@tcp:41: 00000004:00000024:1.0:1782727703.649949:0:8231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1782727703.649973:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:0:x1869325329762432:12345-192.168.201.8@tcp:41: Request processed in 37us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727703.649980:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00080000:3.0:1782727703.650199:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727703.654203:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727703.654374:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329762688 00000100:00100000:1.0:1782727703.654387:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329762688 00000100:00100000:1.0:1782727703.654586:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:1.0:1782727703.654600:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:5427:x1869325329762688:12345-192.168.201.8@tcp:40: 00000100:00100000:1.0:1782727703.654718:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:5427:x1869325329762688:12345-192.168.201.8@tcp:40: Request processed in 120us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727703.654888:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:3.0:1782727703.662811:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727703.662897:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727703.663215:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329762816 00000100:00100000:2.0:1782727703.663229:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329762816 00000100:00100000:2.0:1782727703.663294:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329762944 00000100:00100000:2.0:1782727703.663298:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329762944 00000100:00100000:2.0:1782727703.663316:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:2.0:1782727703.663328:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1869325329762816:12345-192.168.201.8@tcp:8: 00010000:00080000:2.0:1782727703.663464:0:6940:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from 7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1782727703.663527:0:6940:0:(genops.c:1406:class_connect()) connect: client 7bd37c29-d4cd-43a2-9946-117a0c108d30, cookie 0xb393e873fab643b0 00002000:00100000:2.0:1782727703.663545:0:6940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7bd37c29-d4cd-43a2-9946-117a0c108d30/ffff91fcf3afc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782727703.663561:0:6940:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782727703.663833:0:6940:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782727703.663906:0:6940:0:(import.c:65:import_set_state_nolock()) ffff91fcfe2e1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727703.664015:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2349:x1869325329762816:12345-192.168.201.8@tcp:8: Request processed in 687us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727703.664024:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:2.0:1782727703.664049:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:2.0:1782727703.664054:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1869325329762944:12345-192.168.201.8@tcp:8: 00010000:00080000:2.0:1782727703.664075:0:6940:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from 7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1782727703.664096:0:6940:0:(genops.c:1406:class_connect()) connect: client 7bd37c29-d4cd-43a2-9946-117a0c108d30, cookie 0xb393e873fab643b7 00002000:00100000:2.0:1782727703.664103:0:6940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7bd37c29-d4cd-43a2-9946-117a0c108d30/ffff91fcfe2e4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782727703.664121:0:6940:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782727703.664258:0:6940:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782727703.664276:0:6940:0:(import.c:65:import_set_state_nolock()) ffff91fcfe2e4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727703.664303:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2349:x1869325329762944:12345-192.168.201.8@tcp:8: Request processed in 247us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727703.664322:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1782727703.665085:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727703.665657:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727703.665786:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329763072 00000100:00100000:0.0:1782727703.665800:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329763072 00000100:00100000:0.0:1782727703.665897:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:0.0:1782727703.665909:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:5427:x1869325329763072:12345-192.168.201.8@tcp:33: 00000100:00100000:0.0:1782727703.666188:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329763200 00000100:00100000:0.0:1782727703.666192:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329763200 00000100:00100000:0.0:1782727703.666223:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 129 00000100:00100000:0.0:1782727703.666230:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329763200:12345-192.168.201.8@tcp:400: 00000100:00100000:0.0:1782727703.666308:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329763200:12345-192.168.201.8@tcp:400: Request processed in 77us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727703.666316:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 129 00000004:00080000:2.0:1782727703.684030:0:5954:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17997us 00000004:00200000:3.0:1782727703.699001:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1782727703.699130:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:5427:x1869325329763072:12345-192.168.201.8@tcp:33: Request processed in 33217us (34045us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727703.699153:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:2.0:1782727703.971532:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727703.971667:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329763328 00000100:00100000:0.0:1782727703.971680:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329763328 00000100:00100000:0.0:1782727703.971756:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:0.0:1782727703.971769:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:5467:x1869325329763328:12345-192.168.201.8@tcp:101: 00010000:00010000:0.0:1782727703.971792:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727703.971825:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031000/0xb393e873fab643be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488b96 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727703.972052:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab643c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727703.972069:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab643c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727703.972084:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab643c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727703.972134:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727703.972139:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727703.972178:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab643c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727703.972204:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031000/0xb393e873fab643be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b96 expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727703.972229:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab643c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b96 expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727703.972239:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:0.0:1782727703.972242:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727703.972246:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0031200, rc 0) 00000100:00100000:0.0:1782727703.974080:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:5467:x1869325329763328:12345-192.168.201.8@tcp:101: Request processed in 2307us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727703.974089:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00010000:00010000:2.0:1782727704.669483:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727705.692410:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727706.269669:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727706.272372:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329763456 00000100:00100000:0.0:1782727706.272390:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329763456 00000100:00080000:3.0:1782727706.272760:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727706.273050:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:0.0:1782727706.273069:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:5519:x1869325329763456:12345-192.168.201.8@tcp:41: 00000004:00000024:0.0:1782727706.273980:0:5951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:0.0:1782727706.274104:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:5519:x1869325329763456:12345-192.168.201.8@tcp:41: Request processed in 1038us (4443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727706.274115:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1782727706.279735:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727706.279808:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329763584 00000100:00100000:0.0:1782727706.279820:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329763584 00000100:00100000:0.0:1782727706.279945:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:0.0:1782727706.279968:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:5519:x1869325329763584:12345-192.168.201.8@tcp:13: 00002000:00000024:0.0:1782727706.280006:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727706.280101:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:5519:x1869325329763584:12345-192.168.201.8@tcp:13: Request processed in 147us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727706.280110:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00080000:3.0:1782727706.280216:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727706.284467:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727706.284978:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329763712 00000100:00100000:0.0:1782727706.284995:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329763712 00000100:00100000:0.0:1782727706.285137:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:0.0:1782727706.285151:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:5519:x1869325329763712:12345-192.168.201.8@tcp:13: 00002000:00000024:0.0:1782727706.285205:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727706.285322:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:5519:x1869325329763712:12345-192.168.201.8@tcp:13: Request processed in 173us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727706.285330:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00080000:3.0:1782727706.286065:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782727706.716053:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727707.100049:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347611648:0@lo:400: 00000100:00100000:0.0:1782727707.100193:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727707.100297:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782727707.100304:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347611264:0@lo:400: 00000100:00100000:0.0:1782727707.100338:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727707.100385:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347611776:0@lo:400: 00000100:00100000:0.0:1782727707.100415:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727707.100483:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347611392:0@lo:400: 00000100:00100000:0.0:1782727707.100510:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727707.100526:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347611904:0@lo:400: 00000100:00100000:0.0:1782727707.100546:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727707.100576:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727707.100582:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347611520:0@lo:400: 00000100:00100000:0.0:1782727707.100604:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727707.100651:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347611648 00000100:00100000:0.0:1782727707.100671:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347611648 00000100:00100000:0.0:1782727707.100749:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347611904 00000100:00100000:0.0:1782727707.100752:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347611904 00000100:00100000:0.0:1782727707.100774:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727707.100783:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347611648:12345-0@lo:400: 00000100:00100000:0.0:1782727707.100851:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347611648:12345-0@lo:400: Request processed in 69us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727707.100860:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727707.100882:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727707.100887:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347611904:12345-0@lo:400: 00000100:00100000:0.0:1782727707.100917:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347611904:12345-0@lo:400: Request processed in 30us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727707.100924:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727707.100942:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347611264 00000100:00100000:0.0:1782727707.100945:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347611264 00000100:00100000:0.0:1782727707.100970:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782727707.100976:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347611264:12345-0@lo:400: 00000100:00100000:0.0:1782727707.101006:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347611264:12345-0@lo:400: Request processed in 31us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727707.101013:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782727707.101044:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347611776 00000100:00100000:0.0:1782727707.101048:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347611776 00000100:00100000:0.0:1782727707.101076:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347611392 00000100:00100000:0.0:1782727707.101079:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347611392 00000100:00100000:0.0:1782727707.101090:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347611520 00000100:00100000:0.0:1782727707.101092:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347611520 00000100:00100000:0.0:1782727707.101107:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727707.101112:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347611776:12345-0@lo:400: 00000100:00100000:0.0:1782727707.101141:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347611776:12345-0@lo:400: Request processed in 29us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727707.101154:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727707.101164:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782727707.101168:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347611392:12345-0@lo:400: 00000100:00100000:0.0:1782727707.101192:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347611392:12345-0@lo:400: Request processed in 24us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727707.101197:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782727707.101207:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782727707.101212:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347611520:12345-0@lo:400: 00000100:00100000:0.0:1782727707.101239:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347611520:12345-0@lo:400: Request processed in 27us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727707.101246:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1782727707.101275:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782727707.101282:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727707.101284:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727707.101325:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347611520:0@lo:400: 00000100:00100000:0.0:1782727707.101338:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347611392:0@lo:400: 00010000:00080000:0.0:1782727707.101365:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe39ad80 x1869325347611904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727707.101375:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347611904:0@lo:400: 00000100:00100000:0.0:1782727707.101529:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347611264:0@lo:400: 00000100:00100000:0.0:1782727707.101540:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347611776:0@lo:400: 00010000:00080000:0.0:1782727707.101551:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe39a300 x1869325347611648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727707.101561:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347611648:0@lo:400: 00000100:00100000:3.0:1782727707.102803:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347612032:0@lo:13: 00000100:00100000:3.0:1782727707.102884:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727707.102947:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347612032 00000100:00100000:3.0:1782727707.102954:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347612032 00000100:00100000:3.0:1782727707.103022:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782727707.103032:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347612032:12345-0@lo:13: 00002000:00000024:3.0:1782727707.103060:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727707.103121:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347612032:12345-0@lo:13: Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727707.103127:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1782727707.103866:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcf7eed500 x1869325347612032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727707.103896:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347612032:0@lo:13: 00010000:00010000:2.0:1782727707.739695:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727708.124172:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727708.124212:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347612160:0@lo:13: 00000100:00100000:0.0:1782727708.124347:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727708.124795:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347612160 00000100:00100000:0.0:1782727708.124810:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347612160 00000100:00100000:0.0:1782727708.124908:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727708.124920:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347612160:12345-0@lo:13: 00002000:00000024:0.0:1782727708.124973:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727708.125037:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347612160:12345-0@lo:13: Request processed in 117us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727708.125045:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1782727708.125096:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe39a300 x1869325347612160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727708.125119:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347612160:0@lo:13: 00000001:00100000:3.0:1782727708.138409:0:5930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7bd37c29-d4cd-43a2-9946-117a0c108d30 00000001:00100000:0.0:1782727708.147397:0:8008:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bd37c29-d4cd-43a2-9946-117a0c108d30 00010000:00010000:1.0:1782727708.764410:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727708.883802:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727708.883898:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727708.883940:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727708.883977:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727708.884027:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329763840 00000100:00100000:3.0:1782727708.884044:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329763840 00000100:00100000:3.0:1782727708.884332:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 131 00000100:00100000:3.0:1782727708.884358:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329763840:12345-192.168.201.8@tcp:400: 00000100:00100000:3.0:1782727708.884565:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329763840:12345-192.168.201.8@tcp:400: Request processed in 215us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727708.884575:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 131 00000100:00100000:2.0:1782727708.885873:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329764224 00000100:00100000:2.0:1782727708.885889:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329764224 00000100:00100000:2.0:1782727708.885970:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329764096 00000100:00100000:2.0:1782727708.885974:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329764096 00000100:00100000:2.0:1782727708.886005:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:2.0:1782727708.886018:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2353:x1869325329764224:12345-192.168.201.8@tcp:400: 00000100:00080000:3.0:1782727708.886088:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727708.886102:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727708.886129:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2353:x1869325329764224:12345-192.168.201.8@tcp:400: Request processed in 112us (2228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727708.886140:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:2.0:1782727708.886160:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:2.0:1782727708.886168:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329764096:12345-192.168.201.8@tcp:400: 00000100:00100000:2.0:1782727708.886196:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329764096:12345-192.168.201.8@tcp:400: Request processed in 30us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727708.886215:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:0.0:1782727708.887293:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329763968 00000100:00100000:0.0:1782727708.887308:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329763968 00000100:00100000:0.0:1782727708.887396:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:0.0:1782727708.887405:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329763968:12345-192.168.201.8@tcp:400: 00000100:00100000:0.0:1782727708.887505:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329763968:12345-192.168.201.8@tcp:400: Request processed in 100us (3722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727708.887515:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00080000:2.0:1782727708.887979:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1782727709.152034:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bd37c29-d4cd-43a2-9946-117a0c108d30 00000001:02000400:2.0:1782727709.216222:0:8672:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782727709.788357:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727710.812088:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727711.845333:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727712.219600:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727712.219623:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347612288:0@lo:13: 00000100:00100000:1.0:1782727712.219692:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727712.219798:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347612288 00000100:00100000:3.0:1782727712.219806:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347612288 00000100:00100000:3.0:1782727712.219884:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727712.219895:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347612288:12345-0@lo:13: 00002000:00000024:3.0:1782727712.219925:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727712.219971:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347612288:12345-0@lo:13: Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727712.219978:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1782727712.220068:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcf7eed500 x1869325347612288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727712.220088:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347612288:0@lo:13: 00000100:00080000:2.0:1782727712.220674:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727712.220921:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347612672:0@lo:400: 00000100:00100000:1.0:1782727712.220982:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727712.221003:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727712.221007:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347612800:0@lo:400: 00000100:00100000:1.0:1782727712.221025:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727712.221080:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347612416:0@lo:400: 00000100:00100000:0.0:1782727712.221106:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727712.221142:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347612928:0@lo:400: 00000100:00100000:0.0:1782727712.221156:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727712.221171:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727712.221174:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347612544:0@lo:400: 00000100:00100000:0.0:1782727712.221185:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727712.221213:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347612672 00000100:00100000:0.0:1782727712.221219:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347612672 00000100:00100000:0.0:1782727712.221268:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347612928 00000100:00100000:0.0:1782727712.221272:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347612928 00000100:00100000:0.0:1782727712.221287:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347612544 00000100:00100000:0.0:1782727712.221289:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347612544 00000100:00100000:0.0:1782727712.221304:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782727712.221309:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347612672:12345-0@lo:400: 00000100:00100000:0.0:1782727712.221342:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347612672:12345-0@lo:400: Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727712.221347:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782727712.221358:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727712.221361:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347612928:12345-0@lo:400: 00000100:00100000:0.0:1782727712.221378:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347612928:12345-0@lo:400: Request processed in 17us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727712.221382:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727712.221388:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727712.221391:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347612544:12345-0@lo:400: 00000100:00100000:0.0:1782727712.221404:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347612544:12345-0@lo:400: Request processed in 13us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727712.221407:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727712.221454:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347612544:0@lo:400: 00000100:00100000:0.0:1782727712.221468:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347612928:0@lo:400: 00000100:00100000:0.0:1782727712.221483:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347612672:0@lo:400: 00000100:00100000:1.0:1782727712.222192:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347612416 00000100:00100000:1.0:1782727712.222200:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347612416 00000100:00100000:1.0:1782727712.222267:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782727712.222275:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347612416:12345-0@lo:400: 00000100:00100000:1.0:1782727712.222327:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347612416:12345-0@lo:400: Request processed in 53us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727712.222333:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782727712.222470:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347612800 00000100:00100000:2.0:1782727712.222474:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347612800 00000100:00100000:2.0:1782727712.222519:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727712.222527:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347612800:12345-0@lo:400: 00000100:00100000:2.0:1782727712.222572:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347612800:12345-0@lo:400: Request processed in 48us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727712.222578:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1782727712.222593:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782727712.222597:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782727712.222624:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec54fb80 x1869325347612800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727712.222639:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347612800:0@lo:400: 00000100:00100000:0.0:1782727712.222861:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347612416:0@lo:400: 00010000:00010000:1.0:1782727712.859773:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782727713.096802:0:8820:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeecec5ac0 20000000:00000080:3.0:1782727713.096830:0:8820:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91fcf7c54400 uarg=0000000000000000 20000000:01000000:3.0:1782727713.096888:0:8820:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1782727713.096892:0:8820:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1782727713.096895:0:8820:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782727713.096899:0:8820:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782727713.096904:0:8820:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1782727713.096998:0:8820:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782727713.097002:0:8820:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727713.100915:0:8821:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1782727713.102054:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1782727713.102090:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1782727713.102109:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1782727713.102122:0:8820:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782727713.102125:0:8820:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727713.103910:0:8822:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1782727713.104224:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1782727713.104398:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1782727713.104420:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1782727713.104580:0:8820:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782727713.104583:0:8820:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727713.105099:0:8823:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1782727713.105414:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1782727713.105572:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1782727713.105603:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1782727713.105691:0:8820:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1782727713.105693:0:8820:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727713.106009:0:8824:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1782727713.106180:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1782727713.106202:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1782727713.106216:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1782727713.106228:0:8820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782727713.106255:0:8820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106407:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc567a200/0xb393e873fab642c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab642c2 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106416:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc0030200/0xb393e873fab642f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab642ec expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106602:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcd346d800/0xb393e873fab6431d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64316 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106803:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcd346c400/0xb393e873fab6432b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64324 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106810:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64332 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106817:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc567b000/0xb393e873fab64355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab6434e expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106825:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc0030a00/0xb393e873fab6437f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64378 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106836:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcf3a76600/0xb393e873fab6438d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b34 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106855:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc567a600/0xb393e873fab64394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b3b expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106863:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106905:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc567a600/0xb393e873fab64394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b3b expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.106920:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91fcc567a600/0xb393e873fab64394 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b3b expref: 9 pid: 5944 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727713.106937:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eefb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613056:192.168.201.8@tcp:104: 00010000:00010000:3.0:1782727713.107092:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcf3a76600/0xb393e873fab6438d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b34 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.107100:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91fcf3a76600/0xb393e873fab6438d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b34 expref: 9 pid: 5946 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727713.107110:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613184:192.168.201.8@tcp:104: 00010000:00010000:3.0:1782727713.107163:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc0030a00/0xb393e873fab6437f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64378 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.107171:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc0030a00/0xb393e873fab6437f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64378 expref: 18 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727713.107181:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613312:0@lo:104: 00000100:00100000:3.0:1782727713.107220:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727713.107356:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc567b000/0xb393e873fab64355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab6434e expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.107366:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc567b000/0xb393e873fab64355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab6434e expref: 18 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727713.107375:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eedc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613440:0@lo:104: 00000100:00100000:3.0:1782727713.107403:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727713.107463:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64332 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.107470:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64332 expref: 18 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727713.107478:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eeca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613568:0@lo:104: 00010000:00010000:3.0:1782727713.107500:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcd346c400/0xb393e873fab6432b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64324 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.107507:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcd346c400/0xb393e873fab6432b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64324 expref: 18 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727713.107514:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613696:0@lo:104: 00010000:00010000:3.0:1782727713.107538:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcd346d800/0xb393e873fab6431d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64316 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.107546:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcd346d800/0xb393e873fab6431d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64316 expref: 18 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727713.107553:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613824:0@lo:104: 00010000:00010000:3.0:1782727713.107575:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc0030200/0xb393e873fab642f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab642ec expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.107590:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc0030200/0xb393e873fab642f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab642ec expref: 18 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727713.107599:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613952:0@lo:104: 00000100:00100000:1.0:1782727713.107785:0:5935:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782727713.107805:0:5935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727713.107817:0:5935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727713.107835:0:5935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727713.107844:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347613312 00000100:00100000:1.0:1782727713.107851:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347613312 00000100:00100000:1.0:1782727713.107890:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347613440 00000100:00100000:1.0:1782727713.107893:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347613440 00000100:00100000:1.0:1782727713.107902:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347613568 00000100:00100000:1.0:1782727713.107904:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347613568 00000100:00100000:1.0:1782727713.107913:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347613696 00000100:00100000:1.0:1782727713.107915:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347613696 00000100:00100000:1.0:1782727713.107923:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347613824 00000100:00100000:1.0:1782727713.107925:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347613824 00000100:00100000:1.0:1782727713.107938:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727713.107947:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+7:8820:x1869325347613312:12345-0@lo:104: 00010000:00010000:1.0:1782727713.107960:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727713.108015:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727713.108022:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+7:8820:x1869325347613312:12345-0@lo:104: Request processed in 76us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727713.108029:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727713.108047:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727713.108053:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfde35850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+6:8820:x1869325347613440:12345-0@lo:104: 00010000:00010000:1.0:1782727713.108060:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727713.108095:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782727713.108100:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfde35850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+6:8820:x1869325347613440:12345-0@lo:104: Request processed in 49us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727713.108106:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727713.108143:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727713.108156:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+5:8820:x1869325347613568:12345-0@lo:104: 00010000:00010000:1.0:1782727713.108164:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727713.108191:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782727713.108195:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+5:8820:x1869325347613568:12345-0@lo:104: Request processed in 42us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727713.108200:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727713.108212:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782727713.108217:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:8820:x1869325347613696:12345-0@lo:104: 00010000:00010000:1.0:1782727713.108223:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727713.108259:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1782727713.108265:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:8820:x1869325347613696:12345-0@lo:104: Request processed in 48us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727713.108270:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782727713.108280:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782727713.108297:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:8820:x1869325347613824:12345-0@lo:104: 00010000:00010000:1.0:1782727713.108303:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727713.108327:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1782727713.108331:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:8820:x1869325347613824:12345-0@lo:104: Request processed in 47us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727713.108336:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727713.108453:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727713.108486:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc567a200/0xb393e873fab642c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab642c2 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727713.108496:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc567a200/0xb393e873fab642c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab642c2 expref: 18 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727713.108505:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347614080:0@lo:104: 00000100:00100000:3.0:1782727713.108527:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727713.108538:0:8820:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fe0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727713.108559:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613312:0@lo:104: 00000100:00100000:3.0:1782727713.108566:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eedc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613440:0@lo:104: 00000100:00100000:3.0:1782727713.108573:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eeca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613568:0@lo:104: 00000100:00100000:3.0:1782727713.108579:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613696:0@lo:104: 00000100:00100000:3.0:1782727713.108586:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613824:0@lo:104: 00000100:00100000:0.0:1782727713.108851:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347613952 00000100:00100000:0.0:1782727713.108858:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347613952 00000100:00100000:0.0:1782727713.108883:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347614080 00000100:00100000:0.0:1782727713.108886:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347614080 00000100:00100000:0.0:1782727713.108898:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727713.108906:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:8820:x1869325347613952:12345-0@lo:104: 00010000:00010000:0.0:1782727713.108915:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.108968:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1782727713.108975:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:8820:x1869325347613952:12345-0@lo:104: Request processed in 70us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.108981:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727713.108992:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727713.108997:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:8820:x1869325347614080:12345-0@lo:104: 00010000:00010000:0.0:1782727713.109005:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.109045:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1782727713.109049:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:8820:x1869325347614080:12345-0@lo:104: Request processed in 53us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.109055:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782727713.109986:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613952:0@lo:104: 00000100:00100000:3.0:1782727713.110001:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347614080:0@lo:104: 00010000:00010000:0.0:1782727713.110316:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1782727713.110339:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110348:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346c800 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:0.0:1782727713.110353:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110363:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727713.110371:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727713.110376:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727713.110446:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110453:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727713.110474:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110481:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcd346c800/0xb393e873fab64378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6437f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110499:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1782727713.110502:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110507:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346ce00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:0.0:1782727713.110510:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110527:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727713.110534:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727713.110538:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727713.110552:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110558:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727713.110572:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110589:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcd346ce00/0xb393e873fab6434e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64355 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110599:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782727713.110602:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110606:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567b600 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:0.0:1782727713.110609:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110614:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727713.110619:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727713.110631:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727713.110646:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110651:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727713.110657:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110663:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc567b600/0xb393e873fab64332 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64339 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110674:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782727713.110678:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110684:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc0031e00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:0.0:1782727713.110686:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110693:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727713.110698:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727713.110703:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727713.110718:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110723:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727713.110735:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110741:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6432b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110752:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782727713.110755:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110762:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346de00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:0.0:1782727713.110764:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110771:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727713.110776:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727713.110780:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727713.110793:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110798:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727713.110802:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110807:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcd346de00/0xb393e873fab64316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6431d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110816:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782727713.110824:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110830:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567b400 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:0.0:1782727713.110832:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110838:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727713.110844:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727713.110849:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727713.110863:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110869:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727713.110873:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110879:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc567b400/0xb393e873fab642ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab642f3 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110888:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727713.110891:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110897:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a77400 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:0.0:1782727713.110899:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110917:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727713.110922:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727713.110927:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727713.110940:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110946:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727713.110951:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110957:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77400/0xb393e873fab642c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab642c9 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.110971:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727713.110973:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727713.110974:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727713.111003:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347614592:0@lo:103: 00000100:00100000:0.0:1782727713.111071:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727713.111131:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782727713.111138:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347614208:0@lo:103: 00000100:00100000:0.0:1782727713.111160:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727713.111177:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347614720:0@lo:103: 00000100:00100000:0.0:1782727713.111196:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727713.111218:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347614464:0@lo:103: 00000100:00100000:0.0:1782727713.111261:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727713.111271:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347614976:0@lo:103: 00000100:00100000:0.0:1782727713.111289:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727713.111299:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782727713.111304:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347614336:0@lo:103: 00000100:00100000:0.0:1782727713.111322:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727713.111330:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347614848:0@lo:103: 00000100:00100000:0.0:1782727713.111374:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727713.111401:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347614592 00000100:00100000:0.0:1782727713.111409:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347614592 00010000:00010000:0.0:1782727713.111466:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcd346c400/0xb393e873fab6432b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64324 expref: 19 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727713.111486:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347614208 00000100:00100000:0.0:1782727713.111488:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347614208 00010000:00010000:0.0:1782727713.111499:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc0030a00/0xb393e873fab6437f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64378 expref: 20 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727713.111509:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347614720 00000100:00100000:0.0:1782727713.111512:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347614720 00010000:00010000:0.0:1782727713.111521:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcd346d800/0xb393e873fab6431d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64316 expref: 21 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727713.111530:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347614464 00000100:00100000:0.0:1782727713.111532:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347614464 00010000:00010000:0.0:1782727713.111542:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64332 expref: 22 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727713.111552:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347614976 00000100:00100000:0.0:1782727713.111554:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347614976 00010000:00010000:0.0:1782727713.111573:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc567a200/0xb393e873fab642c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab642c2 expref: 23 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727713.111584:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347614336 00000100:00100000:0.0:1782727713.111586:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347614336 00010000:00010000:0.0:1782727713.111596:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc567b000/0xb393e873fab64355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab6434e expref: 24 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727713.111604:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347614848 00000100:00100000:0.0:1782727713.111606:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347614848 00010000:00010000:0.0:1782727713.111614:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc0030200/0xb393e873fab642f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab642ec expref: 25 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727713.111629:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727713.111636:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+25:3442:x1869325347614592:12345-0@lo:103: 00010000:00010000:0.0:1782727713.111650:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727713.111655:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcd346c400/0xb393e873fab6432b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64324 expref: 25 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111664:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcd346c400/0xb393e873fab6432b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64324 expref: 25 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111676:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcd346c400/0xb393e873fab6432b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64324 expref: 25 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111692:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727713.111730:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+24:3442:x1869325347614592:12345-0@lo:103: Request processed in 93us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.111737:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727713.111753:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727713.111759:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+23:3442:x1869325347614208:12345-0@lo:103: 00010000:00010000:0.0:1782727713.111774:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727713.111779:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc0030a00/0xb393e873fab6437f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64378 expref: 23 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111788:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc0030a00/0xb393e873fab6437f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64378 expref: 23 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111798:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc0030a00/0xb393e873fab6437f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64378 expref: 23 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111808:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727713.111832:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+22:3442:x1869325347614208:12345-0@lo:103: Request processed in 73us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.111838:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727713.111850:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727713.111855:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+21:3442:x1869325347614720:12345-0@lo:103: 00010000:00010000:0.0:1782727713.111863:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727713.111867:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcd346d800/0xb393e873fab6431d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64316 expref: 21 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111875:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcd346d800/0xb393e873fab6431d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64316 expref: 21 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111884:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcd346d800/0xb393e873fab6431d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64316 expref: 21 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111892:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727713.111914:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+20:3442:x1869325347614720:12345-0@lo:103: Request processed in 58us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.111929:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727713.111943:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727713.111949:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347614464:12345-0@lo:103: 00010000:00010000:0.0:1782727713.111957:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727713.111961:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64332 expref: 19 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111969:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64332 expref: 19 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111978:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc0031c00/0xb393e873fab64339 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64332 expref: 19 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.111986:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727713.112013:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:3445:x1869325347614464:12345-0@lo:103: Request processed in 64us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.112019:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727713.112029:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727713.112035:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:3445:x1869325347614976:12345-0@lo:103: 00010000:00010000:0.0:1782727713.112042:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727713.112046:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc567a200/0xb393e873fab642c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab642c2 expref: 17 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.112053:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc567a200/0xb393e873fab642c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab642c2 expref: 17 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.112062:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc567a200/0xb393e873fab642c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab642c2 expref: 17 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.112079:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727713.112102:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3445:x1869325347614976:12345-0@lo:103: Request processed in 67us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.112108:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727713.112120:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727713.112125:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:3445:x1869325347614336:12345-0@lo:103: 00010000:00010000:0.0:1782727713.112131:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727713.112135:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc567b000/0xb393e873fab64355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab6434e expref: 15 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.112143:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc567b000/0xb393e873fab64355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab6434e expref: 15 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.112152:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc567b000/0xb393e873fab64355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab6434e expref: 15 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.112160:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727713.112182:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:3445:x1869325347614336:12345-0@lo:103: Request processed in 57us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.112188:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727713.112199:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727713.112205:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcde698050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:3445:x1869325347614848:12345-0@lo:103: 00010000:00010000:0.0:1782727713.112212:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727713.112216:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc0030200/0xb393e873fab642f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab642ec expref: 13 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.112225:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc0030200/0xb393e873fab642f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab642ec expref: 13 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.112254:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc0030200/0xb393e873fab642f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab642ec expref: 13 pid: 5944 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.112264:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727713.112288:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcde698050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:3445:x1869325347614848:12345-0@lo:103: Request processed in 83us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.112294:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727713.112351:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347614336:0@lo:103: 00000100:00100000:0.0:1782727713.112360:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347614848:0@lo:103: 00000100:00100000:0.0:1782727713.112367:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347614464:0@lo:103: 00000100:00100000:0.0:1782727713.112374:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347614976:0@lo:103: 00000100:00100000:0.0:1782727713.112407:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347614208:0@lo:103: 00000100:00100000:0.0:1782727713.112415:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347614720:0@lo:103: 00000100:00100000:0.0:1782727713.112444:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347614592:0@lo:103: 00010000:00010000:3.0:1782727713.112892:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727713.115522:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eefb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613056:192.168.201.8@tcp:104: 00000100:00100000:0.0:1782727713.115545:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325347613184:192.168.201.8@tcp:104: 00010000:00010000:0.0:1782727713.115605:0:8820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727713.117524:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727713.117561:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727713.117676:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329764352 00000100:00100000:2.0:1782727713.117686:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329764352 00010000:00010000:2.0:1782727713.117736:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc567a600/0xb393e873fab64394 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b3b expref: 10 pid: 5944 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727713.117779:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329764480 00000100:00100000:2.0:1782727713.117783:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329764480 00010000:00010000:2.0:1782727713.117794:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcf3a76600/0xb393e873fab6438d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b34 expref: 11 pid: 5946 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727713.117808:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:2.0:1782727713.117838:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3a2b312-3952-4d62-a958-96e4c68c622a+11:2350:x1869325329764352:12345-192.168.201.8@tcp:103: 00010000:00010000:2.0:1782727713.117858:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727713.117866:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff91fcc567a600/0xb393e873fab64394 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b3b expref: 11 pid: 5944 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.117879:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc567a600/0xb393e873fab64394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b3b expref: 11 pid: 5944 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.117900:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc567a600/0xb393e873fab64394 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b3b expref: 11 pid: 5944 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.117915:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727713.117981:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329764352:12345-192.168.201.8@tcp:103: Request processed in 144us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727713.117989:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:2.0:1782727713.118011:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:2.0:1782727713.118019:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3a2b312-3952-4d62-a958-96e4c68c622a+9:2350:x1869325329764480:12345-192.168.201.8@tcp:103: 00010000:00010000:2.0:1782727713.118025:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727713.118030:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff91fcf3a76600/0xb393e873fab6438d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b34 expref: 9 pid: 5946 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118039:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcf3a76600/0xb393e873fab6438d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b34 expref: 9 pid: 5946 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118050:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcf3a76600/0xb393e873fab6438d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b34 expref: 9 pid: 5946 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118061:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118078:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118095:0:5937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118103:0:5937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118111:0:5937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118118:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118125:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346c600 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:2.0:1782727713.118130:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118138:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118151:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727713.118161:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727713.118182:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3a2b312-3952-4d62-a958-96e4c68c622a+8:2350:x1869325329764480:12345-192.168.201.8@tcp:103: Request processed in 164us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727713.118189:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00010000:00010000:0.0:1782727713.118473:0:8820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.118495:0:8820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.118502:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcd346c600/0xb393e873fab643cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727713.248644:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347615104:0@lo:13: 00000100:00100000:0.0:1782727713.248722:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727713.249437:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347615104 00000100:00100000:0.0:1782727713.249449:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347615104 00000100:00100000:0.0:1782727713.249501:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727713.249509:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347615104:12345-0@lo:13: 00002000:00000024:0.0:1782727713.249544:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727713.250011:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347615104:12345-0@lo:13: Request processed in 499us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.250020:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1782727713.250136:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec5d2d80 x1869325347615104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727713.250171:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347615104:0@lo:13: 00000100:00100000:3.0:1782727713.439575:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727713.439712:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329764608 00000100:00100000:1.0:1782727713.439738:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329764608 00000100:00100000:1.0:1782727713.439872:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 133 00000100:00100000:1.0:1782727713.439885:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+8:5441:x1869325329764608:12345-192.168.201.8@tcp:101: 00010000:00010000:1.0:1782727713.439904:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727713.439927:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567ba00/0xb393e873fab643d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488b9d expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727713.439956:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567ba00/0xb393e873fab643d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b9d expref: 9 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727713.439979:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567ba00/0xb393e873fab643d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b9d expref: 9 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727713.439988:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567ba00, rc 0) 00000100:00100000:1.0:1782727713.440064:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5441:x1869325329764608:12345-192.168.201.8@tcp:101: Request processed in 182us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727713.440072:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 133 00000100:00100000:3.0:1782727713.442074:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727713.442828:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329764736 00000100:00100000:0.0:1782727713.442837:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329764736 00000100:00100000:0.0:1782727713.442879:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 134 00000100:00100000:0.0:1782727713.442887:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5441:x1869325329764736:12345-192.168.201.8@tcp:501: 00000100:00100000:0.0:1782727713.443041:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5441:x1869325329764736:12345-192.168.201.8@tcp:501: Request processed in 153us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.443048:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 134 00000100:00100000:0.0:1782727713.444810:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727713.444954:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329764864 00000100:00100000:3.0:1782727713.444988:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329764864 00000100:00100000:3.0:1782727713.445030:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 135 00000100:00100000:3.0:1782727713.445037:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5441:x1869325329764864:12345-192.168.201.8@tcp:503: 00000100:00100000:3.0:1782727713.445180:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5441:x1869325329764864:12345-192.168.201.8@tcp:503: Request processed in 142us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727713.445188:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 135 00000100:00100000:3.0:1782727713.451277:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727713.453542:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329764992 00000100:00100000:0.0:1782727713.453559:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329764992 00000100:00100000:0.0:1782727713.453649:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 136 00000100:00100000:0.0:1782727713.453658:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5907:x1869325329764992:12345-192.168.201.8@tcp:502: 00000100:00100000:0.0:1782727713.453831:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5907:x1869325329764992:12345-192.168.201.8@tcp:502: Request processed in 173us (2602us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.453840:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 136 00000100:00100000:0.0:1782727713.456063:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727713.456208:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329765120 00000100:00100000:3.0:1782727713.456218:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329765120 00000100:00100000:3.0:1782727713.456277:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 137 00000100:00100000:3.0:1782727713.456288:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5907:x1869325329765120:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782727713.456490:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5907:x1869325329765120:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 201us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727713.456499:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 137 00000100:00100000:3.0:1782727713.461007:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727713.461654:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329765248 00000100:00100000:0.0:1782727713.461669:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329765248 00000100:00100000:0.0:1782727713.461766:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 138 00000100:00100000:0.0:1782727713.461777:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5441:x1869325329765248:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727713.461799:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727713.461820:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc0031c00/0xb393e873fab643da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488ba4 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.461856:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc0031c00/0xb393e873fab643da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ba4 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.461869:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc0031c00/0xb393e873fab643da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ba4 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727713.461878:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0031c00, rc 0) 00000100:00100000:0.0:1782727713.461956:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329765248:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 181us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727713.462176:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 138 00000100:00100000:0.0:1782727713.466306:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727713.466585:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329765376 00000100:00100000:1.0:1782727713.466595:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329765376 00000100:00100000:1.0:1782727713.466687:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 139 00000100:00100000:1.0:1782727713.466698:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329765376:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727713.466840:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329765376:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 143us (544us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782727713.466850:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 139 00010000:00010000:0.0:1782727713.883910:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727713.984178:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727713.984223:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727713.984275:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727713.984311:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329765632 00000100:00100000:3.0:1782727713.984319:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329765632 00000100:00100000:3.0:1782727713.984386:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329765760 00000100:00100000:3.0:1782727713.984389:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329765760 00000100:00100000:3.0:1782727713.984408:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1782727713.984420:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2353:x1869325329765632:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727713.984557:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2353:x1869325329765632:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 139us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727713.984565:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1782727713.984600:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:3.0:1782727713.984608:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2353:x1869325329765760:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727713.984636:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2353:x1869325329765760:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727713.984643:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00080000:3.0:1782727713.984662:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727713.984666:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727713.985352:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329765504 00000100:00100000:2.0:1782727713.985358:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329765504 00000100:00100000:2.0:1782727713.985417:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:2.0:1782727713.985454:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329765504:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727713.985500:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329765504:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 75us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727713.985507:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00080000:3.0:1782727713.985918:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727714.907771:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782727715.072407:0:8872:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8647d740 20000000:00000080:0.0:1782727715.073019:0:8872:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91fcf3b95000 uarg=0000000000000000 20000000:01000000:0.0:1782727715.073187:0:8872:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782727715.073194:0:8872:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782727715.073198:0:8872:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782727715.073870:0:8873:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1782727715.074043:0:8872:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1782727715.077950:0:8872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1782727715.077993:0:8872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1782727715.078008:0:8872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1782727715.078024:0:8872:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782727715.078061:0:8872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.078079:0:8872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc567aa00/0xb393e873fab641b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab641b1 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.078088:0:8872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc0031600/0xb393e873fab6421a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64213 expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.078095:0:8872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcf3a77600/0xb393e873fab642e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab642de expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.078105:0:8872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcc567be00/0xb393e873fab643a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b6c expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.078113:0:8872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.078156:0:8872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc567be00/0xb393e873fab643a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b6c expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.078172:0:8872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91fcc567be00/0xb393e873fab643a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b6c expref: 9 pid: 5944 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727715.078187:0:8872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe395f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8872:1869325347615232:192.168.201.8@tcp:104: 00010000:00010000:1.0:1782727715.078321:0:8872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcf3a77600/0xb393e873fab642e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab642de expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.078330:0:8872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcf3a77600/0xb393e873fab642e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab642de expref: 11 pid: 5944 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727715.078353:0:8872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe396680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8872:1869325347615360:0@lo:104: 00000100:00100000:1.0:1782727715.078396:0:8872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782727715.078471:0:8872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc0031600/0xb393e873fab6421a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64213 expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.078480:0:8872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc0031600/0xb393e873fab6421a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64213 expref: 11 pid: 5944 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727715.078489:0:8872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe395500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8872:1869325347615488:0@lo:104: 00000100:00100000:1.0:1782727715.078516:0:8872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.078559:0:5935:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782727715.078575:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347615360 00000100:00100000:1.0:1782727715.078582:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347615360 00000100:00100000:1.0:1782727715.078622:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347615488 00000100:00100000:1.0:1782727715.078625:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347615488 00000100:00100000:1.0:1782727715.078641:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782727715.078649:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:8872:x1869325347615360:12345-0@lo:104: 00010000:00010000:1.0:1782727715.078662:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.079205:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727715.079224:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:8872:x1869325347615360:12345-0@lo:104: Request processed in 575us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.079233:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782727715.079257:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782727715.079264:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:8872:x1869325347615488:12345-0@lo:104: 00010000:00010000:1.0:1782727715.079274:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.080293:0:8872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcc567aa00/0xb393e873fab641b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab641b1 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.080308:0:8872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcc567aa00/0xb393e873fab641b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab641b1 expref: 11 pid: 5945 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727715.080321:0:8872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8872:1869325347615616:0@lo:104: 00000100:00100000:0.0:1782727715.080371:0:8872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.080410:0:8872:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727715.080453:0:8872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe396680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8872:1869325347615360:0@lo:104: 00000100:00100000:0.0:1782727715.080463:0:8872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe395500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8872:1869325347615488:0@lo:104: 00000100:00100000:3.0:1782727715.080678:0:5934:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1782727715.080688:0:5934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1782727715.081550:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782727715.081559:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.081569:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76e00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:2.0:1782727715.081574:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.081584:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727715.081591:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727715.081597:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782727715.081650:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.081656:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727715.081688:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.081696:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76e00/0xb393e873fab642de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab642e5 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.081712:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727715.081716:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.081721:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346dc00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:2.0:1782727715.081724:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.081731:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727715.081736:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727715.081740:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782727715.081753:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.081759:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727715.081773:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.081777:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcd346dc00/0xb393e873fab64213 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6421a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.081783:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727715.081789:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727715.081791:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727715.081803:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347615744:0@lo:103: 00000100:00100000:2.0:1782727715.081845:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.081891:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347615872:0@lo:103: 00000100:00100000:2.0:1782727715.081913:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.081945:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347615744 00000100:00100000:2.0:1782727715.081952:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347615744 00010000:00010000:2.0:1782727715.081982:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcf3a77600/0xb393e873fab642e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab642de expref: 12 pid: 5944 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727715.082011:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347615872 00000100:00100000:2.0:1782727715.082015:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347615872 00010000:00010000:2.0:1782727715.082027:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc0031600/0xb393e873fab6421a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64213 expref: 13 pid: 5944 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727715.082041:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727715.082050:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:3443:x1869325347615744:12345-0@lo:103: 00010000:00010000:2.0:1782727715.082064:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727715.082070:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcf3a77600/0xb393e873fab642e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab642de expref: 13 pid: 5944 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.082079:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcf3a77600/0xb393e873fab642e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab642de expref: 13 pid: 5944 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.082092:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcf3a77600/0xb393e873fab642e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab642de expref: 13 pid: 5944 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.082104:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727715.082136:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:3443:x1869325347615744:12345-0@lo:103: Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.082149:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727715.082166:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782727715.082171:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:3444:x1869325347615872:12345-0@lo:103: 00010000:00010000:2.0:1782727715.082179:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727715.082183:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc0031600/0xb393e873fab6421a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64213 expref: 11 pid: 5944 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.082192:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc0031600/0xb393e873fab6421a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64213 expref: 11 pid: 5944 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.082201:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc0031600/0xb393e873fab6421a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64213 expref: 11 pid: 5944 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.082224:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727715.082252:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:3444:x1869325347615872:12345-0@lo:103: Request processed in 80us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.082258:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782727715.082299:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347615872:0@lo:103: 00000100:00100000:2.0:1782727715.082323:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347615744:0@lo:103: 00000100:00100000:3.0:1782727715.083019:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347615616 00000100:00100000:3.0:1782727715.083026:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347615616 00000100:00100000:2.0:1782727715.083140:0:8874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727715.083146:0:8874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:8872:x1869325347615616:12345-0@lo:104: 00010000:00010000:2.0:1782727715.083158:0:8874:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcd346cc00/0xb393e873fab641b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.083235:0:8874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727715.083241:0:8874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:8872:x1869325347615616:12345-0@lo:104: Request processed in 95us (2870us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.083252:0:8874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1782727715.083302:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727715.083308:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcd346cc00/0xb393e873fab641b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.083315:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346cc00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:3.0:1782727715.083319:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346cc00/0xb393e873fab641b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.083328:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcd346cc00/0xb393e873fab641b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727715.083336:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346cc00/0xb393e873fab641b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727715.083342:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782727715.083374:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcd346cc00/0xb393e873fab641b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.083386:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727715.083399:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcd346cc00/0xb393e873fab641b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.083404:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcd346cc00/0xb393e873fab641b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab641b8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.083415:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727715.083416:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727715.083417:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727715.083446:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347616000:0@lo:103: 00000100:00100000:3.0:1782727715.083477:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.083514:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347616000 00000100:00100000:3.0:1782727715.083517:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347616000 00010000:00010000:3.0:1782727715.083530:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc567aa00/0xb393e873fab641b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab641b1 expref: 10 pid: 5945 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727715.083544:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727715.083548:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:3445:x1869325347616000:12345-0@lo:103: 00010000:00010000:3.0:1782727715.083557:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727715.083561:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc567aa00/0xb393e873fab641b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab641b1 expref: 10 pid: 5945 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.083566:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc567aa00/0xb393e873fab641b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab641b1 expref: 10 pid: 5945 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.083575:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727715.083591:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:3445:x1869325347616000:12345-0@lo:103: Request processed in 43us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.083600:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727715.083623:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347616000:0@lo:103: 00000100:00100000:0.0:1782727715.083813:0:8872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe395f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8872:1869325347615232:192.168.201.8@tcp:104: 00010000:00010000:0.0:1782727715.083824:0:8872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc567aa00/0xb393e873fab641b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab641b1 expref: 9 pid: 5945 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727715.083832:0:8872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8872:1869325347615616:0@lo:104: 00010000:00010000:0.0:1782727715.083851:0:8872:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.083946:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1782727715.083952:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:8872:x1869325347615488:12345-0@lo:104: Request processed in 4690us (5435us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.083958:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1782727715.084016:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727715.086775:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727715.086836:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329765888 00000100:00100000:2.0:1782727715.086848:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329765888 00010000:00010000:2.0:1782727715.086899:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcc567be00/0xb393e873fab643a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b6c expref: 10 pid: 5944 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727715.086967:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:2.0:1782727715.086976:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329765888:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782727715.086992:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727715.086996:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcc567be00/0xb393e873fab643a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b6c expref: 10 pid: 5944 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087008:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcc567be00/0xb393e873fab643a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b6c expref: 10 pid: 5944 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087024:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc567be00/0xb393e873fab643a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b6c expref: 10 pid: 5944 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087042:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087049:0:5938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087063:0:5938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087067:0:5938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087084:0:5938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087089:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087093:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567ae00 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:2.0:1782727715.087096:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087101:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087116:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.087125:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727715.087205:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3a2b312-3952-4d62-a958-96e4c68c622a+9:2350:x1869325329765888:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 229us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.087221:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 24 00010000:00010000:0.0:1782727715.087536:0:8872:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.087543:0:8872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.087547:0:8872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc567ae00/0xb393e873fab643e1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727715.109791:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782727715.109804:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91fcfde9a000 from 39 10000000:01000000:0.0:1782727715.109810:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727715.109876:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab643e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.109889:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab643e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.109901:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab643e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727715.109930:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347616128:0@lo:101: 00000100:00100000:0.0:1782727715.110040:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.110099:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcde614240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727715.110128:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347616128 00000100:00100000:0.0:1782727715.110137:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347616128 00000100:00100000:0.0:1782727715.110205:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782727715.110227:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+9:5948:x1869325347616128:12345-0@lo:101: 00010000:00010000:0.0:1782727715.110244:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727715.110261:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc0030e00/0xb393e873fab643ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab643e8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.110286:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc0030e00/0xb393e873fab643ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab643e8 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.110296:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc0030e00/0xb393e873fab643ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab643e8 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.110323:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0030e00, rc 0) 00000100:00100000:0.0:1782727715.110364:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:5948:x1869325347616128:12345-0@lo:101: Request processed in 139us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727715.110371:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782727715.110455:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347616128:0@lo:101: 00010000:00010000:0.0:1782727715.110472:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab643e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab643ef expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.110482:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab643e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab643ef expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727715.110549:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347616256:0@lo:501: 00000100:00100000:0.0:1782727715.110573:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.110595:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcde614240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727715.110607:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347616256 00000100:00100000:0.0:1782727715.110611:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347616256 00000100:00100000:0.0:1782727715.110633:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782727715.110639:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:5948:x1869325347616256:12345-0@lo:501: 00000100:00100000:0.0:1782727715.110905:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:5948:x1869325347616256:12345-0@lo:501: Request processed in 265us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727715.110912:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782727715.110957:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347616256:0@lo:501: 00000100:00100000:0.0:1782727715.110981:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347616384:0@lo:503: 00000100:00100000:0.0:1782727715.111021:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.111035:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcde614240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727715.111053:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347616384 00000100:00100000:0.0:1782727715.111057:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347616384 00000100:00100000:0.0:1782727715.111079:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782727715.111086:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:5948:x1869325347616384:12345-0@lo:503: 00000100:00100000:0.0:1782727715.111159:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:5948:x1869325347616384:12345-0@lo:503: Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727715.111165:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782727715.111222:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347616384:0@lo:503: 00000100:00100000:0.0:1782727715.111453:0:8877:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8877:1869325347616512:0@lo:502: 00000100:00100000:0.0:1782727715.111490:0:8877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.111510:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347616512 00000100:00100000:0.0:1782727715.111515:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347616512 00000100:00100000:0.0:1782727715.111537:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782727715.111544:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:8877:x1869325347616512:12345-0@lo:502: 00000100:00100000:0.0:1782727715.111604:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:8877:x1869325347616512:12345-0@lo:502: Request processed in 60us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727715.111611:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782727715.111652:0:8877:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0e710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727715.111665:0:8877:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8877:1869325347616512:0@lo:502: 00000100:00100000:0.0:1782727715.112505:0:8877:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8877:1869325347616640:0@lo:502: 00000100:00100000:0.0:1782727715.112550:0:8877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.112588:0:8877:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fccf6d1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.112659:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347616640 00000100:00100000:2.0:1782727715.112665:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347616640 00000100:00100000:2.0:1782727715.112821:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782727715.112830:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:8877:x1869325347616640:12345-0@lo:502: 00000100:00100000:3.0:1782727715.113057:0:8877:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8877:1869325347616640:0@lo:502: 00000040:00080000:3.0:1782727715.113082:0:8877:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1782727715.113183:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:8877:x1869325347616640:12345-0@lo:502: Request processed in 107us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.113190:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000020:01000000:0.0:1782727715.122292:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782727715.122339:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727715.122353:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab643e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab643ef expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.122381:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc0031000/0xb393e873fab643e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab643ef expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727715.122391:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1782727715.122393:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1782727715.122396:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782727715.122459:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab643f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.122469:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab643f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.122482:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab643f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727715.122513:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347616768:0@lo:101: 00000100:00100000:0.0:1782727715.122604:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.122661:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fccf6d1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727715.124260:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347616768 00000100:00100000:0.0:1782727715.124275:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347616768 00000100:00100000:0.0:1782727715.124391:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782727715.124402:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+10:5948:x1869325347616768:12345-0@lo:101: 00010000:00010000:0.0:1782727715.124447:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727715.124465:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc0030200/0xb393e873fab643fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab643f6 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.124493:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc0030200/0xb393e873fab643fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab643f6 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.124520:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc0030200/0xb393e873fab643fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab643f6 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.124528:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0030200, rc 0) 00000100:00100000:0.0:1782727715.124607:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5948:x1869325347616768:12345-0@lo:101: Request processed in 207us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727715.124614:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782727715.124730:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347616768:0@lo:101: 00010000:00010000:3.0:1782727715.124748:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab643f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab643fd expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.124757:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab643f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab643fd expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727715.124847:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347616896:0@lo:501: 00000100:00100000:3.0:1782727715.124884:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.125366:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fe0240 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.125398:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347616896 00000100:00100000:2.0:1782727715.125412:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347616896 00000100:00100000:2.0:1782727715.125456:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782727715.125461:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5948:x1869325347616896:12345-0@lo:501: 00000100:00100000:2.0:1782727715.125622:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5948:x1869325347616896:12345-0@lo:501: Request processed in 159us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.125628:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782727715.126508:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347616896:0@lo:501: 00000100:00100000:2.0:1782727715.126554:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347617024:0@lo:503: 00000100:00100000:2.0:1782727715.126602:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.126644:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcfde7ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727715.126687:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347617024 00000100:00100000:0.0:1782727715.126693:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347617024 00000100:00100000:0.0:1782727715.126852:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782727715.126861:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5948:x1869325347617024:12345-0@lo:503: 00000100:00100000:0.0:1782727715.126964:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5948:x1869325347617024:12345-0@lo:503: Request processed in 103us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727715.126971:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782727715.127018:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347617024:0@lo:503: 00000100:00100000:0.0:1782727715.127274:0:8879:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8879:1869325347617152:0@lo:502: 00000100:00100000:0.0:1782727715.127307:0:8879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.127331:0:8879:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.127341:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347617152 00000100:00100000:2.0:1782727715.127345:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347617152 00000100:00100000:2.0:1782727715.127368:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782727715.127375:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:8879:x1869325347617152:12345-0@lo:502: 00000100:00100000:2.0:1782727715.127501:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:8879:x1869325347617152:12345-0@lo:502: Request processed in 125us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.127508:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782727715.127530:0:8879:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8879:1869325347617152:0@lo:502: 00000020:01000000:0.0:1782727715.127551:0:8879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727715.127561:0:8879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727715.127563:0:8879:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782727715.127571:0:8879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782727715.127592:0:8879:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8879:1869325347617280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727715.127631:0:8879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.127667:0:8879:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.128786:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347617280 00000100:00100000:3.0:1782727715.128795:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347617280 00000100:00100000:3.0:1782727715.128844:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782727715.128852:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:8879:x1869325347617280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.129041:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:8879:x1869325347617280:12345-0@lo:502:llog_process_th.0 Request processed in 189us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.129048:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782727715.129129:0:8879:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8879:1869325347617280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727715.129160:0:8879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727715.129167:0:8879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727715.129168:0:8879:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782727715.129172:0:8879:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1782727715.129912:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1782727715.129999:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782727715.130010:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab643f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab643fd expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.130021:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc0031600/0xb393e873fab643f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab643fd expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727715.130029:0:5948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782727715.130032:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91fcfde9a000 from 4 10000000:01000000:0.0:1782727715.130034:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782727715.130068:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.130076:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.130085:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727715.130106:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347617408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727715.130152:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.130243:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.135317:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347617408 00000100:00100000:3.0:1782727715.135336:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347617408 00000100:00100000:3.0:1782727715.135404:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782727715.135414:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+11:5948:x1869325347617408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727715.135467:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727715.135491:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcd346cc00/0xb393e873fab6440b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64404 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.135524:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcd346cc00/0xb393e873fab6440b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64404 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.135537:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcd346cc00/0xb393e873fab6440b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64404 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.135546:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346cc00, rc 0) 00000100:00100000:3.0:1782727715.135637:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347617408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (5484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.135644:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782727715.135675:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347617408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727715.135695:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.135704:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727715.135804:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe395180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347617536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.135842:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.135889:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.136182:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347617536 00000100:00100000:2.0:1782727715.136188:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347617536 00000100:00100000:2.0:1782727715.136232:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782727715.136240:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347617536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.136355:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347617536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.136362:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782727715.136392:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe395180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347617536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.136441:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347617664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.136483:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.136505:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcfde7e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.136517:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347617664 00000100:00100000:2.0:1782727715.136521:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347617664 00000100:00100000:2.0:1782727715.136541:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782727715.136546:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347617664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.136625:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347617664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.136632:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782727715.136668:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347617664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727715.137397:0:8881:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8881:1869325347617792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.137571:0:8881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.137643:0:8881:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fe0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.137676:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347617792 00000100:00100000:2.0:1782727715.137681:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347617792 00000100:00100000:2.0:1782727715.137816:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782727715.137825:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8881:x1869325347617792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727715.137920:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8881:x1869325347617792:12345-0@lo:502:llog_process_th.0 Request processed in 96us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.137927:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782727715.138015:0:8881:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8881:1869325347617792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727715.138041:0:8881:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727715.138053:0:8881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727715.138056:0:8881:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782727715.138063:0:8881:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91fcfde9a000 00000020:00000080:0.0:1782727715.138067:0:8881:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782727715.138149:0:8881:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8881:1869325347617920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727715.138186:0:8881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.138381:0:8881:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.138420:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347617920 00000100:00100000:3.0:1782727715.138442:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347617920 00000100:00100000:3.0:1782727715.138466:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782727715.138472:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8881:x1869325347617920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.138597:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:8881:x1869325347617920:12345-0@lo:502:llog_process_th.0 Request processed in 125us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.138603:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782727715.141104:0:8881:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8881:1869325347617920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727715.141152:0:8881:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727715.141162:0:8881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727715.141165:0:8881:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782727715.141169:0:8881:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782727715.142884:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782727715.142914:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727715.142925:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.143004:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727715.143017:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782727715.143020:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91fcf9d2c000 from 39 10000000:01000000:2.0:1782727715.143029:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727715.143061:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77600/0xb393e873fab64412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.143069:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77600/0xb393e873fab64412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.143079:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77600/0xb393e873fab64412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727715.143100:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.143161:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.143252:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcfde7e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.144918:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347618048 00000100:00100000:3.0:1782727715.145068:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347618048 00000100:00100000:3.0:1782727715.145248:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782727715.145262:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+12:5948:x1869325347618048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727715.145289:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727715.145308:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcd346da00/0xb393e873fab64419 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64412 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.145335:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcd346da00/0xb393e873fab64419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64412 expref: 13 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.145345:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcd346da00/0xb393e873fab64419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64412 expref: 13 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.145353:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346da00, rc 0) 00000100:00100000:3.0:1782727715.145445:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347618048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.145452:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782727715.146522:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727715.146551:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77600/0xb393e873fab64412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64419 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.146565:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77600/0xb393e873fab64412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64419 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727715.146652:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.146724:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.146770:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf3a62480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.146789:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347618176 00000100:00100000:2.0:1782727715.146794:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347618176 00000100:00100000:2.0:1782727715.146840:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782727715.146849:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347618176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.147153:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347618176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.147176:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782727715.147230:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.147262:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.147303:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.147317:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf3a62480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.147330:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347618304 00000100:00100000:2.0:1782727715.147333:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347618304 00000100:00100000:2.0:1782727715.147351:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782727715.147357:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347618304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.147471:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347618304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.147478:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782727715.147517:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.149257:0:8884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8884:1869325347618432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727715.149329:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.149390:0:8884:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d4b600 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.149463:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347618432 00000100:00100000:3.0:1782727715.149473:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347618432 00000100:00100000:3.0:1782727715.149542:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782727715.149553:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8884:x1869325347618432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.150047:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8884:x1869325347618432:12345-0@lo:502:llog_process_th.0 Request processed in 495us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.150056:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782727715.150132:0:8884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8884:1869325347618432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.150193:0:8884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8884:1869325347618560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.150244:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.150268:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347618560 00000100:00100000:3.0:1782727715.150272:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347618560 00000100:00100000:3.0:1782727715.150293:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782727715.150307:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8884:x1869325347618560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.150365:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:8884:x1869325347618560:12345-0@lo:502:llog_process_th.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.150370:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782727715.150409:0:8884:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fe00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.150445:0:8884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8884:1869325347618560:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782727715.150464:0:8884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782727715.150538:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782727715.150559:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727715.150571:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77600/0xb393e873fab64412 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64419 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.150581:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcf3a77600/0xb393e873fab64412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64419 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727715.150591:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782727715.150593:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1782727715.150596:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727715.150625:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346d400/0xb393e873fab64420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.150635:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcd346d400/0xb393e873fab64420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.150644:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcd346d400/0xb393e873fab64420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727715.150656:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727715.152012:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.153088:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fe00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.154827:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347618688 00000100:00100000:2.0:1782727715.154849:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347618688 00000100:00100000:2.0:1782727715.156075:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782727715.156095:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+13:5948:x1869325347618688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727715.156119:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727715.156146:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64420 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.156186:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64420 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.156224:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcf3a76e00/0xb393e873fab64427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64420 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.156235:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a76e00, rc 0) 00000100:00100000:2.0:1782727715.156341:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347618688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (4409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.156349:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782727715.158488:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727715.158525:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcd346d400/0xb393e873fab64420 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64427 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.158541:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcd346d400/0xb393e873fab64420 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64427 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727715.158649:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.158713:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.158768:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62240 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.158777:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347618816 00000100:00100000:3.0:1782727715.158785:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347618816 00000100:00100000:3.0:1782727715.158838:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782727715.158848:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347618816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727715.159122:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347618816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.159129:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727715.159131:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782727715.159178:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.161312:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.164550:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727715.164621:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347618944 00000100:00100000:1.0:1782727715.164638:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347618944 00000100:00100000:1.0:1782727715.164752:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782727715.164767:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347618944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.165016:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347618944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (3709us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.165024:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782727715.165107:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347618944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.168184:0:8886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8886:1869325347619072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727715.169038:0:8886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.169108:0:8886:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.169254:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347619072 00000100:00100000:2.0:1782727715.169263:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347619072 00000100:00100000:2.0:1782727715.169316:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782727715.169325:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8886:x1869325347619072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727715.169492:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8886:x1869325347619072:12345-0@lo:502:llog_process_th.0 Request processed in 166us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.169500:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782727715.170319:0:8886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8886:1869325347619072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727715.170358:0:8886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727715.170370:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727715.170373:0:8886:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782727715.170394:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782727715.170460:0:8886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8886:1869325347619200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727715.170522:0:8886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.170565:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347619200 00000100:00100000:2.0:1782727715.170571:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347619200 00000100:00100000:1.0:1782727715.170571:0:8886:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.170612:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782727715.170620:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8886:x1869325347619200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727715.170742:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:8886:x1869325347619200:12345-0@lo:502:llog_process_th.0 Request processed in 122us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.170750:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782727715.171650:0:8886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8886:1869325347619200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727715.171687:0:8886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727715.171694:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727715.171697:0:8886:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782727715.171702:0:8886:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1782727715.173060:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1782727715.173103:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782727715.173116:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346d400/0xb393e873fab64420 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64427 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.173146:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcd346d400/0xb393e873fab64420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64427 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727715.173158:0:5948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782727715.173161:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91fcf9d2c000 from 4 10000000:01000000:2.0:1782727715.173164:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727715.173231:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.173241:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.173252:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727715.173279:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347619328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.175095:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.175161:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d4b000 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.175193:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347619328 00000100:00100000:2.0:1782727715.175204:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347619328 00000100:00100000:2.0:1782727715.175283:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782727715.175294:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+14:5948:x1869325347619328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727715.175314:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727715.175335:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcf3a76800/0xb393e873fab64435 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab6442e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.175372:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a76800/0xb393e873fab64435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab6442e expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.175403:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcf3a76800/0xb393e873fab64435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab6442e expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.175412:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a76800, rc 0) 00000100:00100000:2.0:1782727715.175585:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347619328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 291us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.175593:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782727715.175654:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347619328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727715.175672:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.175681:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727715.176117:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347619456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.176157:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.176197:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d4b000 going to sleep for 11 seconds 00000100:00100000:1.0:1782727715.176240:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347619456 00000100:00100000:1.0:1782727715.176247:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347619456 00000100:00100000:1.0:1782727715.176288:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782727715.176296:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347619456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.176469:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347619456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.176476:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782727715.176512:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347619456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.176541:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347619584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.176585:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.176598:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727715.176610:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347619584 00000100:00100000:1.0:1782727715.176614:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347619584 00000100:00100000:1.0:1782727715.176636:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782727715.176641:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347619584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.176726:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347619584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.176732:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782727715.176780:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347619584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.182652:0:8887:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8887:1869325347619712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727715.182922:0:8887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.183218:0:8887:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d4b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727715.183852:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347619712 00000100:00100000:1.0:1782727715.183863:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347619712 00000100:00100000:1.0:1782727715.183923:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782727715.183933:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:8887:x1869325347619712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727715.184105:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:8887:x1869325347619712:12345-0@lo:502:llog_process_th.0 Request processed in 173us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.184114:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1782727715.184342:0:8887:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8887:1869325347619712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727715.184384:0:8887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727715.184398:0:8887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727715.184401:0:8887:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782727715.184411:0:8887:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91fcf9d2c000 00000020:00000080:3.0:1782727715.184414:0:8887:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727715.184618:0:8887:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8887:1869325347619840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.184670:0:8887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.184733:0:8887:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fe0240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727715.184863:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347619840 00000100:00100000:1.0:1782727715.184870:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347619840 00000100:00100000:1.0:1782727715.184918:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782727715.184925:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:8887:x1869325347619840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727715.185014:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:8887:x1869325347619840:12345-0@lo:502:llog_process_th.0 Request processed in 87us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.185020:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1782727715.186101:0:8887:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8887:1869325347619840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727715.186138:0:8887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727715.186146:0:8887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727715.186148:0:8887:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782727715.186153:0:8887:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1782727715.189160:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1782727715.189204:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727715.189234:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.189248:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727715.189261:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782727715.189265:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91fcc90cc800 from 39 10000000:01000000:1.0:1782727715.189268:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727715.189329:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567a600/0xb393e873fab6443c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.189353:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc567a600/0xb393e873fab6443c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.189370:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc567a600/0xb393e873fab6443c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727715.189412:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347619968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.189545:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.189603:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62240 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.189769:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347619968 00000100:00100000:3.0:1782727715.189779:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347619968 00000100:00100000:3.0:1782727715.189844:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1782727715.189855:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+15:5948:x1869325347619968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727715.189880:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727715.189897:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcd346d000/0xb393e873fab64443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab6443c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.189923:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcd346d000/0xb393e873fab64443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab6443c expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.189933:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcd346d000/0xb393e873fab64443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab6443c expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.191081:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346d000, rc 0) 00000100:00100000:3.0:1782727715.191172:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347619968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1316us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.191182:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782727715.193955:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347619968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727715.194003:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc567a600/0xb393e873fab6443c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64443 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.194022:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc567a600/0xb393e873fab6443c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64443 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727715.194127:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347620096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.194188:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.194253:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727715.194280:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347620096 00000100:00100000:1.0:1782727715.194286:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347620096 00000100:00100000:1.0:1782727715.194338:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782727715.194348:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347620096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.194559:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347620096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.194569:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782727715.194620:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347620096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.194650:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347620224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.194688:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.194709:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727715.194892:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347620224 00000100:00100000:1.0:1782727715.194897:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347620224 00000100:00100000:1.0:1782727715.194915:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782727715.194922:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347620224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.195006:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347620224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.195014:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782727715.195053:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347620224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.195273:0:8890:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8890:1869325347620352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727715.195309:0:8890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.195326:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347620352 00000100:00100000:1.0:1782727715.195330:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347620352 00000100:00100000:1.0:1782727715.195347:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782727715.195353:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:8890:x1869325347620352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727715.195437:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:8890:x1869325347620352:12345-0@lo:502:llog_process_th.0 Request processed in 68us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.195445:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782727715.195479:0:8890:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727715.195491:0:8890:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8890:1869325347620352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727715.200110:0:8890:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8890:1869325347620480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727715.200246:0:8890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.200320:0:8890:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62480 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.200336:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347620480 00000100:00100000:3.0:1782727715.200347:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347620480 00000100:00100000:3.0:1782727715.200442:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782727715.200454:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:8890:x1869325347620480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.200607:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:8890:x1869325347620480:12345-0@lo:502:llog_process_th.0 Request processed in 155us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.200615:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782727715.200668:0:8890:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8890:1869325347620480:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782727715.200693:0:8890:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782727715.204850:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782727715.204888:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727715.204905:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567a600/0xb393e873fab6443c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64443 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.204922:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc567a600/0xb393e873fab6443c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64443 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727715.205042:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782727715.205045:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1782727715.205049:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727715.205102:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346ca00/0xb393e873fab6444a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.205111:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcd346ca00/0xb393e873fab6444a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.205124:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcd346ca00/0xb393e873fab6444a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727715.205158:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347620608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727715.205345:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.205418:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcc2c33840 going to sleep for 11 seconds 00000100:00100000:1.0:1782727715.205502:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347620608 00000100:00100000:1.0:1782727715.205515:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347620608 00000100:00100000:1.0:1782727715.205576:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1782727715.205586:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347620608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727715.205601:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727715.205615:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567b000/0xb393e873fab64451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab6444a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.205646:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567b000/0xb393e873fab64451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab6444a expref: 17 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.205656:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567b000/0xb393e873fab64451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab6444a expref: 17 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.205666:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567b000, rc 0) 00000100:00100000:1.0:1782727715.205773:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347620608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.205780:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1782727715.205846:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347620608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727715.205862:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcd346ca00/0xb393e873fab6444a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64451 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727715.205871:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcd346ca00/0xb393e873fab6444a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64451 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727715.205956:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347620736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.205987:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.206020:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62480 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.206030:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347620736 00000100:00100000:3.0:1782727715.206035:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347620736 00000100:00100000:3.0:1782727715.206072:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782727715.206079:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347620736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727715.206343:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347620736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.206350:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782727715.207099:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347620736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.207163:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347620864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.207236:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727715.207277:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd3c62480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727715.207295:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347620864 00000100:00100000:1.0:1782727715.207300:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347620864 00000100:00100000:1.0:1782727715.207341:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782727715.207349:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347620864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727715.207484:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347620864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727715.207491:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782727715.212048:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347620864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727715.213709:0:8892:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8892:1869325347620992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.213823:0:8892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.213871:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347620992 00000100:00100000:3.0:1782727715.213880:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347620992 00000100:00100000:3.0:1782727715.214325:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782727715.214349:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:8892:x1869325347620992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.214540:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:8892:x1869325347620992:12345-0@lo:502:llog_process_th.0 Request processed in 197us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.214548:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782727715.214617:0:8892:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.214646:0:8892:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8892:1869325347620992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727715.215013:0:8892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727715.215028:0:8892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727715.215030:0:8892:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782727715.215038:0:8892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782727715.215072:0:8892:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8892:1869325347621120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.215109:0:8892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.215136:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347621120 00000100:00100000:3.0:1782727715.215141:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347621120 00000100:00100000:3.0:1782727715.215166:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782727715.215172:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:8892:x1869325347621120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.215327:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:8892:x1869325347621120:12345-0@lo:502:llog_process_th.0 Request processed in 153us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.215334:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782727715.215370:0:8892:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcde614240 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.215384:0:8892:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8892:1869325347621120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727715.215403:0:8892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727715.215408:0:8892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727715.215410:0:8892:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782727715.215413:0:8892:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1782727715.215529:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1782727715.215558:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782727715.215577:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346ca00/0xb393e873fab6444a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64451 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.215588:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcd346ca00/0xb393e873fab6444a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64451 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727715.215598:0:5948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782727715.215600:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91fcc90cc800 from 4 10000000:01000000:3.0:1782727715.215603:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727715.215633:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.215642:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.215653:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727715.215667:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347621248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727715.217908:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.218086:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.222484:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347621248 00000100:00100000:2.0:1782727715.222510:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347621248 00000100:00100000:2.0:1782727715.222595:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1782727715.222607:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347621248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727715.222633:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727715.222667:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6445f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64458 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.223344:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6445f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64458 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.223362:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6445f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64458 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.223375:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a76000, rc 0) 00000100:00100000:2.0:1782727715.223509:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347621248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 904us (5610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.223519:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1782727715.223611:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347621248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727715.223639:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.223668:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727715.223848:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347621376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.224799:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.224878:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d4b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.224916:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347621376 00000100:00100000:2.0:1782727715.224927:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347621376 00000100:00100000:2.0:1782727715.225057:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1782727715.225066:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347621376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.225524:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347621376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 455us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.225547:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1782727715.225607:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347621376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.225661:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347621504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.226373:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.226410:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9d4b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.226467:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347621504 00000100:00100000:2.0:1782727715.226474:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347621504 00000100:00100000:2.0:1782727715.226515:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782727715.226523:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347621504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.226621:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347621504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.226629:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782727715.226672:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347621504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727715.229397:0:8894:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8894:1869325347621632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.229661:0:8894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727715.230091:0:8894:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcd0ff2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727715.230137:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347621632 00000100:00100000:0.0:1782727715.230146:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347621632 00000100:00100000:0.0:1782727715.230260:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1782727715.230272:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:8894:x1869325347621632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727715.230473:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:8894:x1869325347621632:12345-0@lo:502:llog_process_th.0 Request processed in 202us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727715.230483:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782727715.230593:0:8894:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8894:1869325347621632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727715.230628:0:8894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727715.230646:0:8894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727715.230649:0:8894:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782727715.230658:0:8894:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91fcc90cc800 00000020:00000080:3.0:1782727715.230669:0:8894:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727715.230782:0:8894:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8894:1869325347621760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727715.230821:0:8894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727715.231198:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347621760 00000100:00100000:2.0:1782727715.231214:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347621760 00000100:00100000:2.0:1782727715.231252:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1782727715.231260:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:8894:x1869325347621760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727715.231338:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:8894:x1869325347621760:12345-0@lo:502:llog_process_th.0 Request processed in 79us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.231344:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782727715.233669:0:8894:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fe0180 going to sleep for 11 seconds 00000100:00100000:3.0:1782727715.233807:0:8894:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:8894:1869325347621760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727715.233860:0:8894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727715.233871:0:8894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727715.233873:0:8894:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782727715.233879:0:8894:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1782727715.236627:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1782727715.236668:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782727715.236681:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.237027:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727715.237833:0:5948:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782727715.237839:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91fcf9dc33a0 from 1 10000000:01000000:0.0:1782727715.237844:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782727715.237888:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.237909:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.237923:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727715.238325:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347621888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727715.238415:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.238571:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.240640:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347621888 00000100:00100000:2.0:1782727715.240655:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347621888 00000100:00100000:2.0:1782727715.240777:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1782727715.240788:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347621888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727715.240818:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727715.240839:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcf3a77800/0xb393e873fab6446d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64466 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.240869:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcf3a77800/0xb393e873fab6446d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64466 expref: 19 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.240880:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcf3a77800/0xb393e873fab6446d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64466 expref: 19 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727715.240889:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77800, rc 0) 00000100:00100000:2.0:1782727715.241018:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347621888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (2602us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.241025:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782727715.241127:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347621888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727715.241143:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6446d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.241152:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6446d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727715.241304:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347622016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727715.241339:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727715.241368:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0ab4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727715.241412:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347622016 00000100:00100000:2.0:1782727715.241417:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347622016 00000100:00100000:2.0:1782727715.241469:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1782727715.241476:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347622016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727715.241561:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347622016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (222us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727715.241568:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1782727715.241662:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347622016:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1782727715.241768:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782727715.241775:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6446d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727715.241783:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc0031e00/0xb393e873fab64466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6446d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727715.361546:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727715.365044:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329766016 00000100:00100000:2.0:1782727715.365062:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329766016 00000100:00100000:3.0:1782727715.365651:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 187 00000100:00100000:3.0:1782727715.365663:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5441:x1869325329766016:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727715.365927:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727715.365947:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcd346dc00/0xb393e873fab64474 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bab expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.365979:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcd346dc00/0xb393e873fab64474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bab expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.365990:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcd346dc00/0xb393e873fab64474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bab expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727715.365999:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346dc00, rc 0) 00000100:00100000:3.0:1782727715.366069:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329766016:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 408us (4537us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.366076:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 187 00000100:00100000:1.0:1782727715.373546:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727715.373723:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329766144 00000100:00100000:0.0:1782727715.373734:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329766144 00000100:00100000:0.0:1782727715.373799:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 188 00000100:00100000:0.0:1782727715.373810:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329766144:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727715.374002:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329766144:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 194us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727715.374011:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 188 00000100:00100000:0.0:1782727715.380173:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727715.380983:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329766272 00000100:00100000:3.0:1782727715.380994:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329766272 00000100:00100000:3.0:1782727715.381089:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 189 00000100:00100000:3.0:1782727715.381113:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc2477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329766272:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727715.381285:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc2477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329766272:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 173us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727715.381294:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 189 00000100:00100000:1.0:1782727715.386784:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727715.386910:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329766400 00000100:00100000:2.0:1782727715.386921:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329766400 00000100:00100000:2.0:1782727715.387028:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 190 00000100:00100000:2.0:1782727715.387039:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce0b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5954:x1869325329766400:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782727715.387194:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce0b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5954:x1869325329766400:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 156us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.387223:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 190 00000100:00100000:1.0:1782727715.399579:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727715.400645:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329766528 00000100:00100000:3.0:1782727715.400657:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329766528 00000100:00100000:2.0:1782727715.400848:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 191 00000100:00100000:2.0:1782727715.400860:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce0b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5954:x1869325329766528:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782727715.401036:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce0b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5954:x1869325329766528:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 178us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727715.401046:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 191 00010000:00010000:2.0:1782727715.937755:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727716.955699:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727717.347288:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347622144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727717.347360:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727717.347448:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347622144 00000100:00100000:1.0:1782727717.347456:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347622144 00000100:00100000:1.0:1782727717.347517:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782727717.347526:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347622144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727717.347575:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727717.347627:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347622144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727717.347633:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1782727717.347669:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782727717.347700:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe397100 x1869325347622144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727717.347717:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347622144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727717.347797:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347622272:0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.347826:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727717.351522:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347622272 00000100:00100000:2.0:1782727717.351537:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347622272 00000100:00100000:2.0:1782727717.351599:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782727717.351609:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347622272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727717.351695:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347622272:12345-0@lo:400:kworker.0 Request processed in 88us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727717.351702:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1782727717.352229:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347622272:0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352242:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347622784:0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352280:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727717.352334:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727717.352341:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347622656:0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352368:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727717.352405:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347622400:0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352454:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727717.352474:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727717.352481:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347622528:0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352502:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727717.352532:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347622656 00000100:00100000:1.0:1782727717.352536:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347622656 00000100:00100000:1.0:1782727717.352578:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727717.352586:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347622656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352636:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347622656:12345-0@lo:400:kworker.0 Request processed in 51us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727717.352643:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727717.352663:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347622784 00000100:00100000:1.0:1782727717.352667:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347622784 00000100:00100000:1.0:1782727717.352692:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347622400 00000100:00100000:1.0:1782727717.352695:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347622400 00000100:00100000:1.0:1782727717.352707:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347622528 00000100:00100000:1.0:1782727717.352710:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347622528 00000100:00100000:1.0:1782727717.352723:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782727717.352729:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347622784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352758:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347622784:12345-0@lo:400:kworker.0 Request processed in 30us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727717.352764:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782727717.352776:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782727717.352781:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347622400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352811:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347622400:12345-0@lo:400:kworker.0 Request processed in 30us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727717.352816:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782727717.352828:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782727717.352833:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347622528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352856:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347622528:12345-0@lo:400:kworker.0 Request processed in 23us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727717.352861:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1782727717.352878:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727717.352882:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782727717.352904:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe394380 x1869325347622656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727717.352923:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347622656:0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352937:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347622784:0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352965:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347622528:0@lo:400:kworker.0 00000100:00100000:1.0:1782727717.352974:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347622400:0@lo:400:kworker.0 00010000:00010000:3.0:1782727717.980023:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727718.373603:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727718.373635:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347622912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727718.373728:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727718.373906:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347622912 00000100:00100000:1.0:1782727718.373915:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347622912 00000100:00100000:1.0:1782727718.375226:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782727718.375242:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347622912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727718.375274:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727718.375336:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347622912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727718.375344:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1782727718.384600:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe397800 x1869325347622912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727718.384642:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347622912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782727719.007901:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727719.122254:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727719.122298:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727719.122341:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727719.122417:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727719.122464:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329767040 00000100:00100000:0.0:1782727719.122475:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329767040 00000100:00100000:0.0:1782727719.122534:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329766912 00000100:00100000:0.0:1782727719.122538:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329766912 00000100:00100000:0.0:1782727719.122556:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:0.0:1782727719.122566:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2352:x1869325329767040:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727719.123623:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329766784 00000100:00100000:2.0:1782727719.123646:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329766784 00000100:00100000:2.0:1782727719.123755:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:2.0:1782727719.123771:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329766784:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727719.123788:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2352:x1869325329767040:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 1212us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727719.123807:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:0.0:1782727719.123850:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:0.0:1782727719.123870:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2352:x1869325329766912:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727719.123876:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329766784:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 105us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727719.123908:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:0.0:1782727719.123938:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2352:x1869325329766912:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 74us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727719.123950:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329766656 00000100:00100000:2.0:1782727719.123959:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329766656 00000100:00100000:0.0:1782727719.123966:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00080000:0.0:1782727719.124004:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782727719.124010:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727719.124013:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 193 00000100:00080000:0.0:1782727719.124015:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727719.124027:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2352:x1869325329766656:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727719.124072:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2352:x1869325329766656:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 49us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727719.124084:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 193 00010000:00010000:1.0:1782727720.028712:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727721.061287:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727721.675245:0:9178:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1782727722.082737:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727722.460760:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347623040:0@lo:400:kworker.0 00000100:00100000:1.0:1782727722.460786:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347623168:0@lo:400:kworker.0 00000100:00100000:3.0:1782727722.460876:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347623424:0@lo:400:kworker.0 00000100:00100000:2.0:1782727722.463680:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727722.463681:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347623296:0@lo:400:kworker.0 00000100:00100000:0.0:1782727722.463734:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727722.463745:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347623552:0@lo:400:kworker.0 00000100:00100000:0.0:1782727722.463754:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347623808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727722.463768:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727722.463776:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727722.463798:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347623040 00000100:00100000:2.0:1782727722.463805:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347623040 00000100:00100000:0.0:1782727722.463810:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347623296 00000100:00100000:0.0:1782727722.463813:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347623296 00000100:00100000:0.0:1782727722.463843:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347623552 00000100:00100000:0.0:1782727722.463846:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347623552 00000100:00100000:2.0:1782727722.463847:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1782727722.463854:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347623040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727722.463862:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782727722.463867:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347623296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727722.463904:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347623040:12345-0@lo:400:kworker.0 Request processed in 50us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727722.463904:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347623296:12345-0@lo:400:kworker.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727722.463912:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1782727722.463912:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782727722.463928:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782727722.463932:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347623552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727722.463959:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347623552:12345-0@lo:400:kworker.0 Request processed in 26us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727722.463965:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1782727722.463981:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727722.464015:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347623296:0@lo:400:kworker.0 00000100:00100000:1.0:1782727722.464106:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727722.464137:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347623680:0@lo:400:kworker.0 00000100:00100000:2.0:1782727722.464282:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347623168 00000100:00100000:2.0:1782727722.464286:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347623168 00000100:00100000:2.0:1782727722.464309:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782727722.464315:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347623168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727722.464377:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347623168:12345-0@lo:400:kworker.0 Request processed in 62us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727722.464383:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727722.464778:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727722.464794:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347623552:0@lo:400:kworker.0 00000100:00100000:1.0:1782727722.464802:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347623680 00000100:00100000:2.0:1782727722.464806:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347623040:0@lo:400:kworker.0 00000100:00100000:1.0:1782727722.464806:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347623680 00000100:00100000:2.0:1782727722.464837:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347623808 00000100:00100000:1.0:1782727722.464837:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782727722.464840:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347623808 00000100:00100000:1.0:1782727722.464849:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3442:x1869325347623680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727722.464863:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727722.464868:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1869325347623808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727722.464882:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3442:x1869325347623680:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00002000:00000024:2.0:1782727722.464888:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727722.464888:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1782727722.464907:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727722.464921:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347623808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1143us total) trans 0 rc 0/0 00010000:00080000:1.0:1782727722.464924:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe397800 x1869325347623680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727722.464927:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727722.464935:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347623680:0@lo:400:kworker.0 00000100:00100000:1.0:1782727722.464955:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347623168:0@lo:400:kworker.0 00010000:00080000:0.0:1782727722.465015:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcf3a65180 x1869325347623808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727722.465037:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347623808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727722.468191:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727722.472127:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347623424 00000100:00100000:2.0:1782727722.472143:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347623424 00000100:00100000:2.0:1782727722.472227:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782727722.472239:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347623424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727722.472352:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347623424:12345-0@lo:400:kworker.0 Request processed in 116us (4173us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727722.472376:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1782727722.472715:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727722.474481:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe396300 x1869325347623424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727722.474511:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347623424:0@lo:400:kworker.0 00010000:00010000:2.0:1782727723.103913:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727723.484120:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727723.484152:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347623936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727723.484235:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727723.484360:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347623936 00000100:00100000:1.0:1782727723.484368:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347623936 00000100:00100000:1.0:1782727723.484443:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782727723.484455:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347623936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727723.484498:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727723.484909:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347623936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 456us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727723.484918:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1782727723.486526:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe394380 x1869325347623936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727723.486586:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347623936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727724.127527:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727724.223901:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727724.223954:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727724.223992:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727724.224021:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727724.224067:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329767296 00000100:00100000:2.0:1782727724.224080:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329767296 00000100:00100000:2.0:1782727724.224187:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:2.0:1782727724.224201:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329767296:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727724.224565:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329767552 00000100:00100000:1.0:1782727724.224570:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329767552 00000100:00100000:1.0:1782727724.224603:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329767424 00000100:00100000:1.0:1782727724.224606:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329767424 00000100:00100000:1.0:1782727724.224623:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:1.0:1782727724.224630:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2352:x1869325329767552:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727724.224883:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329767296:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 684us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727724.224891:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:2.0:1782727724.224921:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329767168 00000100:00100000:2.0:1782727724.224926:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329767168 00000100:00100000:2.0:1782727724.224956:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 195 00000100:00100000:2.0:1782727724.224962:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2352:x1869325329767168:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727724.225273:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2352:x1869325329767552:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 641us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727724.225291:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:1.0:1782727724.225313:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:1.0:1782727724.225320:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2352:x1869325329767424:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727724.225418:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2352:x1869325329767424:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 33us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727724.225458:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00080000:0.0:1782727724.227751:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727724.227766:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727724.227770:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727724.228524:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2352:x1869325329767168:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 3546us (4515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727724.228541:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 195 00010000:00010000:2.0:1782727725.151238:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727726.173505:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727726.971309:0:9423:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing yml_node 00010000:00010000:2.0:1782727727.198725:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727727.584211:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347624064:0@lo:400:kworker.0 00000100:00100000:0.0:1782727727.584269:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347624448:0@lo:400:kworker.0 00000100:00100000:2.0:1782727727.584317:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727727.584317:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727727.584687:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347624576:0@lo:400:kworker.0 00000100:00100000:2.0:1782727727.584728:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727727.584763:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347624192:0@lo:400:kworker.0 00000100:00100000:0.0:1782727727.584793:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727727.584814:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347624064 00000100:00100000:2.0:1782727727.584823:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347624064 00000100:00100000:2.0:1782727727.584983:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782727727.584993:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347624064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727727.585125:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347624064:12345-0@lo:400:kworker.0 Request processed in 132us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727727.585133:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1782727727.585195:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347624064:0@lo:400:kworker.0 00000100:00100000:1.0:1782727727.586278:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347624576 00000100:00100000:0.0:1782727727.586278:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347624704:0@lo:400:kworker.0 00000100:00100000:1.0:1782727727.586286:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347624576 00000100:00100000:0.0:1782727727.586325:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727727.586344:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347624192 00000100:00100000:1.0:1782727727.586347:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347624192 00000100:00100000:0.0:1782727727.586350:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782727727.586357:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347624320:0@lo:400:kworker.0 00000100:00100000:1.0:1782727727.586368:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782727727.586376:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347624576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727727.586380:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727727.586390:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347624832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727727.586412:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727727.586465:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347624320 00000100:00100000:2.0:1782727727.586469:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347624320 00000100:00100000:2.0:1782727727.586492:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782727727.586498:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347624192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782727727.586551:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727727.586666:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347624576:12345-0@lo:400:kworker.0 Request processed in 290us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727727.586675:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782727727.586693:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782727727.586700:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347624320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727727.586758:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347624448 00000100:00100000:0.0:1782727727.586763:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347624448 00000100:00100000:1.0:1782727727.586790:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347624320:12345-0@lo:400:kworker.0 Request processed in 90us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727727.586798:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782727727.586830:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347624704 00000100:00100000:0.0:1782727727.586833:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347624704 00000100:00100000:1.0:1782727727.586840:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347624576:0@lo:400:kworker.0 00000100:00080000:3.0:1782727727.586862:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727727.586865:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727727.586928:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727727.586935:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347624448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727727.586976:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347624448:12345-0@lo:400:kworker.0 Request processed in 42us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727727.587009:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727727.587022:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727727.587028:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347624704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727727.589153:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347624192:12345-0@lo:400:kworker.0 Request processed in 2644us (4348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727727.589169:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782727727.589402:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347624704:12345-0@lo:400:kworker.0 Request processed in 2372us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727727.589413:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782727727.589552:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347624832 00010000:00080000:0.0:1782727727.589601:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec54ea00 x1869325347624448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727727.589619:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347624448:0@lo:400:kworker.0 00000100:00100000:1.0:1782727727.589623:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347624832 00000100:00100000:0.0:1782727727.589666:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347624320:0@lo:400:kworker.0 00000100:00100000:0.0:1782727727.589681:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347624192:0@lo:400:kworker.0 00010000:00080000:0.0:1782727727.589694:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77f9f80 x1869325347624704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727727.589704:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347624704:0@lo:400:kworker.0 00000100:00100000:1.0:1782727727.589742:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782727727.589753:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347624832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727727.589798:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727727.589895:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347624832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727727.589902:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1782727727.589969:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcf3a64a80 x1869325347624832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727727.589988:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347624832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727728.233280:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727728.603740:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347624960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727728.603823:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727728.603878:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347624960 00000100:00100000:2.0:1782727728.603888:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347624960 00000100:00100000:2.0:1782727728.603944:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727728.603955:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347624960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727728.604018:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727728.607031:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347624960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3062us (3192us total) trans 0 rc 0/0 00010000:00080000:0.0:1782727728.607031:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe397800 x1869325347624960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727728.607046:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782727728.607064:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347624960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782727729.244122:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727729.347905:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727729.348029:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727729.350302:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727729.350328:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727729.350372:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329767808 00000100:00100000:3.0:1782727729.350381:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329767808 00000100:00100000:3.0:1782727729.350593:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:3.0:1782727729.350605:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329767808:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727729.350684:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329767808:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727729.350704:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00080000:3.0:1782727729.350727:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727729.350791:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329767936 00000100:00100000:1.0:1782727729.350797:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329767936 00000100:00080000:3.0:1782727729.350862:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727729.350925:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329767680 00000100:00100000:2.0:1782727729.350930:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329767680 00000100:00100000:2.0:1782727729.351006:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 197 00000100:00100000:2.0:1782727729.351021:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329767680:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727729.351062:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329767680:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 42us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727729.351069:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 197 00000100:00100000:0.0:1782727729.353647:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329768064 00000100:00100000:0.0:1782727729.353659:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329768064 00000100:00100000:0.0:1782727729.353717:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:0.0:1782727729.353727:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2349:x1869325329767936:12345-192.168.201.8@tcp:9:kworker.0 00000020:00000080:0.0:1782727729.353771:0:6940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb393e873fab643b0 00000100:00080000:0.0:1782727729.353781:0:6940:0:(import.c:65:import_set_state_nolock()) ffff91fcfe2e1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782727729.353828:0:6940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1782727729.353983:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+2:2349:x1869325329767936:12345-192.168.201.8@tcp:9:kworker.0 Request processed in 245us (6077us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727729.353991:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:0.0:1782727729.354005:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:0.0:1782727729.354011:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2349:x1869325329768064:12345-192.168.201.8@tcp:9:kworker.0 00000020:00000080:0.0:1782727729.354023:0:6940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb393e873fab643b7 00000100:00080000:0.0:1782727729.354029:0:6940:0:(import.c:65:import_set_state_nolock()) ffff91fcfe2e4800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1782727729.354139:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782727729.354249:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1782727729.354574:0:6940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1782727729.354695:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+2:2349:x1869325329768064:12345-192.168.201.8@tcp:9:kworker.0 Request processed in 683us (6665us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727729.354704:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00010000:00010000:0.0:1782727729.354785:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727730.268633:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727730.497741:0:9606:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:0.0:1782727731.291609:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727732.318113:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727732.702359:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347625088:0@lo:400:kworker.0 00000100:00100000:1.0:1782727732.702364:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347625216:0@lo:400:kworker.0 00000100:00100000:1.0:1782727732.706639:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727732.706727:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347625728:0@lo:400:kworker.0 00000100:00100000:1.0:1782727732.706768:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727732.706830:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782727732.706837:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347625728 00000100:00100000:1.0:1782727732.706843:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347625344:0@lo:400:kworker.0 00000100:00100000:3.0:1782727732.706857:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347625728 00000100:00100000:1.0:1782727732.706880:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727732.706925:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347625856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727732.706962:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727732.706973:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727732.706987:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347625728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727732.707078:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347625728:12345-0@lo:400:kworker.0 Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727732.707125:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347625216 00000100:00100000:3.0:1782727732.707130:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727732.707136:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347625216 00000100:00080000:3.0:1782727732.707162:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727732.707200:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347625344 00000100:00100000:2.0:1782727732.707205:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347625344 00000100:00100000:3.0:1782727732.707220:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782727732.707230:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347625216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727732.707258:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782727732.707264:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347625216:12345-0@lo:400:kworker.0 Request processed in 36us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727732.707270:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782727732.707279:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347625344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727732.707365:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347625344:12345-0@lo:400:kworker.0 Request processed in 97us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727732.707374:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1782727732.707402:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727732.708071:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727732.708120:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347625600:0@lo:400:kworker.0 00000100:00100000:0.0:1782727732.708152:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727732.708180:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727732.708210:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347625600 00000100:00100000:0.0:1782727732.708217:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347625472:0@lo:400:kworker.0 00000100:00100000:3.0:1782727732.708221:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347625600 00000100:00100000:0.0:1782727732.708256:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727732.708286:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727732.708297:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347625600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727732.708326:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347625472 00000100:00100000:0.0:1782727732.708333:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347625472 00000100:00100000:1.0:1782727732.708366:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347625216:0@lo:400:kworker.0 00000100:00100000:0.0:1782727732.708375:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1782727732.708386:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77fa300 x1869325347625728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727732.708387:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347625472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727732.708404:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347625728:0@lo:400:kworker.0 00000100:00100000:1.0:1782727732.708448:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347625344:0@lo:400:kworker.0 00000100:00100000:1.0:1782727732.708497:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347625856 00000100:00100000:3.0:1782727732.708505:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347625600:12345-0@lo:400:kworker.0 Request processed in 207us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727732.708508:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347625856 00000100:00100000:3.0:1782727732.708529:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782727732.708566:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727732.708575:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347625856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727732.708597:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727732.708654:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347625856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727732.708660:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1782727732.708788:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcec54ea00 x1869325347625856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727732.708813:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347625856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727732.709125:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347625472:12345-0@lo:400:kworker.0 Request processed in 739us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727732.709134:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1782727732.709342:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77fbb80 x1869325347625472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727732.709354:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347625472:0@lo:400:kworker.0 00000100:00100000:0.0:1782727732.709367:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347625600:0@lo:400:kworker.0 00000100:00100000:2.0:1782727732.709500:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347625088 00000100:00100000:2.0:1782727732.709505:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347625088 00000100:00100000:2.0:1782727732.709548:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1782727732.709555:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347625088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727732.709605:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347625088:12345-0@lo:400:kworker.0 Request processed in 49us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727732.709611:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1782727732.709641:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782727732.709647:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727732.709865:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347625088:0@lo:400:kworker.0 00000001:02000400:1.0:1782727733.111796:0:9705:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:1.0:1782727733.349778:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727733.723845:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727733.723868:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347625984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727733.723970:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727733.724104:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347625984 00000100:00100000:1.0:1782727733.724114:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347625984 00000100:00100000:1.0:1782727733.724179:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727733.724191:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347625984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727733.724224:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727733.724282:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347625984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727733.724289:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1782727733.724376:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe396300 x1869325347625984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727733.724394:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347625984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782727734.363718:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727734.463594:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727734.463727:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727734.463881:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329768320 00000100:00100000:0.0:1782727734.463900:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329768320 00000100:00100000:0.0:1782727734.463983:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:0.0:1782727734.463994:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329768320:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727734.464083:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329768320:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 90us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727734.464091:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00080000:2.0:1782727734.464308:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727734.466638:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329768192 00000100:00100000:3.0:1782727734.466654:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329768192 00000100:00100000:3.0:1782727734.466731:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 199 00000100:00100000:3.0:1782727734.466741:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329768192:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727734.466809:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329768192:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 69us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727734.466817:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 199 00000001:00100000:0.0:1782727735.270820:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bd37c29-d4cd-43a2-9946-117a0c108d30 00000020:00000080:0.0:1782727735.270830:0:6933:0:(genops.c:906:class_export_put()) final put ffff91fcf3afc000/7bd37c29-d4cd-43a2-9946-117a0c108d30 00000001:00100000:1.0:1782727735.271063:0:8008:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bd37c29-d4cd-43a2-9946-117a0c108d30 00000020:00000080:1.0:1782727735.271068:0:8008:0:(genops.c:906:class_export_put()) final put ffff91fcfe2e4000/7bd37c29-d4cd-43a2-9946-117a0c108d30 00000020:00000080:3.0:1782727735.272322:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff91fcf3afc000/7bd37c29-d4cd-43a2-9946-117a0c108d30 for lustre-OST0000 00000020:00000080:3.0:1782727735.272374:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff91fcfe2e4000/7bd37c29-d4cd-43a2-9946-117a0c108d30 for lustre-OST0001 00000020:00000080:3.0:1782727735.272388:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91fcfe2e1800 for lustre-OST0000 00000020:00000080:3.0:1782727735.272392:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91fcfe2e4800 for lustre-OST0001 00010000:00010000:2.0:1782727735.402046:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727735.802795:0:9802:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:3.0:1782727736.411917:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727737.436530:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727737.730182:0:9850:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Mon Jun 29 06:08:56 EDT 2026 00000100:00100000:0.0:1782727737.820387:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347626368:0@lo:400:kworker.0 00000100:00100000:0.0:1782727737.820485:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727737.820537:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782727737.820542:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347626240:0@lo:400:kworker.0 00000100:00100000:1.0:1782727737.820694:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347626496:0@lo:400:kworker.0 00000100:00100000:1.0:1782727737.820725:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727737.820750:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782727737.820754:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347626112:0@lo:400:kworker.0 00000100:00100000:1.0:1782727737.820779:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727737.820798:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347626624:0@lo:400:kworker.0 00000100:00100000:1.0:1782727737.820815:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727737.820856:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347626496 00000100:00100000:1.0:1782727737.820863:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347626496 00000100:00100000:1.0:1782727737.820912:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727737.820920:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347626496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727737.820966:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347626496:12345-0@lo:400:kworker.0 Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727737.820980:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727737.821002:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347626112 00000100:00100000:1.0:1782727737.821005:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347626112 00000100:00100000:1.0:1782727737.821025:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1782727737.821030:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347626112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727737.821056:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347626112:12345-0@lo:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727737.821061:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1782727737.821086:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347626368 00000100:00100000:1.0:1782727737.821088:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347626368 00000100:00100000:1.0:1782727737.821109:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347626624 00000100:00100000:1.0:1782727737.821111:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347626624 00000100:00100000:1.0:1782727737.821127:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782727737.821132:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347626368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727737.821159:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347626368:12345-0@lo:400:kworker.0 Request processed in 27us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727737.821165:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782727737.821174:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782727737.821179:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347626624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727737.821197:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347626624:12345-0@lo:400:kworker.0 Request processed in 19us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727737.821202:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1782727737.821214:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727737.821218:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727737.821246:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347626112:0@lo:400:kworker.0 00000100:00100000:1.0:1782727737.821257:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347626624:0@lo:400:kworker.0 00010000:00080000:1.0:1782727737.821275:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77f8700 x1869325347626496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727737.821285:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347626496:0@lo:400:kworker.0 00000100:00100000:0.0:1782727737.821491:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727737.821515:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347626752:0@lo:400:kworker.0 00000100:00100000:0.0:1782727737.821536:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727737.821640:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347626240 00000100:00100000:1.0:1782727737.821644:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347626240 00000100:00100000:1.0:1782727737.821664:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782727737.821669:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347626240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727737.821696:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347626240:12345-0@lo:400:kworker.0 Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727737.821702:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782727737.821783:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347626368:0@lo:400:kworker.0 00000100:00100000:0.0:1782727737.821802:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347626240:0@lo:400:kworker.0 00000100:00100000:0.0:1782727737.821817:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347626752 00000100:00100000:0.0:1782727737.821820:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347626752 00000100:00100000:0.0:1782727737.821861:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727737.821868:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347626752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727737.821899:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347626752:12345-0@lo:400:kworker.0 Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727737.821904:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1782727737.821924:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77fb100 x1869325347626752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727737.821934:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347626752:0@lo:400:kworker.0 00000100:00080000:1.0:1782727737.822498:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727737.822816:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727737.822839:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347626880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727737.822886:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727737.822995:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347626880 00000100:00100000:0.0:1782727737.823000:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347626880 00000100:00100000:0.0:1782727737.823048:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727737.823056:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347626880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727737.823126:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727737.825055:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347626880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1991us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727737.825092:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1782727737.831948:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77fb100 x1869325347626880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727737.831978:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347626880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782727738.459972:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727738.851086:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727738.851120:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347627008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727738.851225:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727738.852664:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347627008 00000100:00100000:1.0:1782727738.852675:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347627008 00000100:00100000:1.0:1782727738.852738:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727738.852748:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347627008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727738.852783:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727738.852860:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347627008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727738.852868:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1782727738.853042:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe397480 x1869325347627008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727738.853063:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347627008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782727739.486384:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727739.593823:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727739.593881:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727739.593959:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329768576 00000100:00100000:2.0:1782727739.593972:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329768576 00000100:00100000:2.0:1782727739.594052:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:2.0:1782727739.594066:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2350:x1869325329768576:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727739.594159:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2350:x1869325329768576:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 97us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727739.594167:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00080000:1.0:1782727739.594411:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727739.595087:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329768448 00000100:00100000:3.0:1782727739.595094:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329768448 00000100:00100000:3.0:1782727739.595146:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 201 00000100:00100000:3.0:1782727739.595155:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329768448:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727739.595211:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329768448:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 57us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727739.595217:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 201 00010000:00010000:1.0:1782727740.508371:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727741.531791:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727742.561068:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727742.939846:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347627136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727742.939959:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727742.940086:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347627136 00000100:00100000:3.0:1782727742.940097:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347627136 00000100:00100000:3.0:1782727742.940170:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782727742.940180:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347627136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727742.940216:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:0.0:1782727742.940321:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727742.940567:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347627264:0@lo:400:kworker.0 00000100:00100000:0.0:1782727742.940606:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727742.940637:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727742.940642:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347627392:0@lo:400:kworker.0 00000100:00100000:0.0:1782727742.940667:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727742.940696:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347627520:0@lo:400:kworker.0 00000100:00100000:0.0:1782727742.940717:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727742.940766:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347627392 00000100:00100000:0.0:1782727742.940770:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347627392 00000100:00100000:0.0:1782727742.940799:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347627520 00000100:00100000:0.0:1782727742.940801:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347627520 00000100:00100000:0.0:1782727742.940823:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782727742.940829:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347627392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727742.940866:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347627392:12345-0@lo:400:kworker.0 Request processed in 35us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727742.940873:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782727742.940890:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782727742.940907:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347627520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727742.940935:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347627520:12345-0@lo:400:kworker.0 Request processed in 39us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727742.940941:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1782727742.940966:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727742.940994:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347627392:0@lo:400:kworker.0 00000100:00100000:0.0:1782727742.941045:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347627520:0@lo:400:kworker.0 00000100:00100000:0.0:1782727742.941079:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347627264 00000100:00100000:0.0:1782727742.941082:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347627264 00000100:00100000:0.0:1782727742.941109:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782727742.941115:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347627264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727742.941147:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347627264:12345-0@lo:400:kworker.0 Request processed in 32us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727742.941153:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782727742.941183:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347627264:0@lo:400:kworker.0 00000100:00100000:3.0:1782727742.941619:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347627136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1440us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727742.941627:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727742.941734:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727742.941755:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347627776:0@lo:400:kworker.0 00000100:00100000:1.0:1782727742.941787:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727742.941811:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347627776 00000100:00100000:1.0:1782727742.941814:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347627776 00000100:00100000:1.0:1782727742.941841:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782727742.941847:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347627776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727742.941876:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347627776:12345-0@lo:400:kworker.0 Request processed in 29us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727742.941882:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1782727742.941896:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727742.941924:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347627776:0@lo:400:kworker.0 00000100:00100000:0.0:1782727742.942171:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727742.942180:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347627648:0@lo:400:kworker.0 00000100:00100000:0.0:1782727742.942207:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727742.942320:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347627648 00000100:00100000:1.0:1782727742.942325:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347627648 00000100:00080000:0.0:1782727742.942402:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727742.942447:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782727742.942454:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347627648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727742.942494:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347627648:12345-0@lo:400:kworker.0 Request processed in 41us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727742.942500:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1782727742.942562:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77fb480 x1869325347627136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727742.942580:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347627136:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1782727742.942686:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcc33e8380 x1869325347627648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727742.942695:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347627648:0@lo:400:kworker.0 00010000:00010000:2.0:1782727743.582134:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727743.963679:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727743.963701:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347627904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727743.963775:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727743.964003:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347627904 00000100:00100000:0.0:1782727743.964012:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347627904 00000100:00100000:0.0:1782727743.964065:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782727743.964075:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347627904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727743.964104:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727743.964149:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347627904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727743.964156:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1782727743.964192:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcf7da0380 x1869325347627904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727743.964215:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347627904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782727744.603638:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727744.709148:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727744.709205:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727744.709239:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329768832 00000100:00100000:1.0:1782727744.709249:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329768832 00000100:00100000:1.0:1782727744.709312:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00100000:1.0:1782727744.709323:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329768832:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727744.709403:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329768832:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727744.709447:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00080000:1.0:1782727744.709469:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727744.710478:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329768704 00000100:00100000:3.0:1782727744.710485:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329768704 00000100:00100000:3.0:1782727744.710525:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 203 00000100:00100000:3.0:1782727744.710533:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329768704:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727744.710572:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329768704:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 40us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727744.710602:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 203 00010000:00010000:1.0:1782727745.637501:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727746.668825:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727747.676699:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727748.060692:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727748.060720:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347628032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727748.060818:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727748.060972:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347628032 00000100:00100000:0.0:1782727748.060980:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347628032 00000100:00100000:0.0:1782727748.061053:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782727748.061063:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347628032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727748.061100:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727748.061160:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347628032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727748.061168:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1782727748.061323:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782727748.061361:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77f8700 x1869325347628032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727748.061379:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347628032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727748.063304:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347628160:0@lo:400:kworker.0 00000100:00100000:2.0:1782727748.063393:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727748.063685:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347628544:0@lo:400:kworker.0 00000100:00100000:1.0:1782727748.063725:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727748.063798:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347628544 00000100:00100000:1.0:1782727748.063808:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347628544 00000100:00100000:1.0:1782727748.063874:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727748.063883:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347628544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727748.063937:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347628544:12345-0@lo:400:kworker.0 Request processed in 55us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727748.063945:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1782727748.063984:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77fb480 x1869325347628544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727748.063998:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347628544:0@lo:400:kworker.0 00000100:00100000:3.0:1782727748.064242:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347628160 00000100:00100000:3.0:1782727748.064247:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347628160 00000100:00100000:3.0:1782727748.064288:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1782727748.064296:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347628160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727748.064716:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727748.064760:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347628288:0@lo:400:kworker.0 00000100:00100000:0.0:1782727748.064837:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727748.064866:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727748.064873:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347628416:0@lo:400:kworker.0 00000100:00100000:0.0:1782727748.064897:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727748.064945:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347628288 00000100:00100000:0.0:1782727748.064949:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347628288 00000100:00100000:0.0:1782727748.064980:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347628416 00000100:00100000:0.0:1782727748.064983:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347628416 00000100:00100000:0.0:1782727748.065006:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782727748.065012:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347628288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727748.065054:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347628288:12345-0@lo:400:kworker.0 Request processed in 41us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727748.065060:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782727748.065074:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782727748.065080:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347628416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727748.065116:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347628416:12345-0@lo:400:kworker.0 Request processed in 36us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727748.065123:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782727748.065177:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347628416:0@lo:400:kworker.0 00000100:00100000:0.0:1782727748.065187:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347628288:0@lo:400:kworker.0 00000100:00100000:3.0:1782727748.065956:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347628160:12345-0@lo:400:kworker.0 Request processed in 1478us (2381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727748.065967:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1782727748.066084:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347628672:0@lo:400:kworker.0 00000100:00100000:0.0:1782727748.066123:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727748.066282:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347628160:0@lo:400:kworker.0 00000100:00080000:2.0:1782727748.066309:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727748.066315:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727748.067469:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347628672 00000100:00100000:1.0:1782727748.067480:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347628672 00000100:00100000:0.0:1782727748.069790:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782727748.069806:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347628672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727748.069904:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347628672:12345-0@lo:400:kworker.0 Request processed in 102us (3781us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727748.069912:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782727748.069971:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347628672:0@lo:400:kworker.0 00000100:00080000:2.0:1782727748.077002:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727748.701314:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727749.083895:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727749.083914:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347628800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727749.083984:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727749.084291:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347628800 00000100:00100000:2.0:1782727749.084304:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347628800 00000100:00100000:2.0:1782727749.084352:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782727749.084361:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347628800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727749.084391:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727749.084461:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347628800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727749.084466:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1782727749.084528:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcf7da0380 x1869325347628800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727749.084541:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347628800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782727749.725888:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727749.824504:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727749.824550:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727749.825378:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329769088 00000100:00100000:0.0:1782727749.825393:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329769088 00000100:00100000:0.0:1782727749.825512:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:0.0:1782727749.825523:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2350:x1869325329769088:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727749.825618:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2350:x1869325329769088:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 97us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727749.825644:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:0.0:1782727749.825673:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329768960 00000100:00100000:0.0:1782727749.825677:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329768960 00000100:00100000:0.0:1782727749.825706:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 205 00000100:00100000:0.0:1782727749.825728:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329768960:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727749.825757:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329768960:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 30us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727749.825763:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 205 00000100:00080000:2.0:1782727749.827267:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727750.747555:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727751.772040:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727752.797716:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727753.180992:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727753.181018:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347629056:0@lo:400:kworker.0 00000100:00100000:2.0:1782727753.181097:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727753.181169:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325347629184:0@lo:400:kworker.0 00000100:00100000:2.0:1782727753.181192:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727753.181258:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727753.181265:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347629568:0@lo:400:kworker.0 00000100:00100000:2.0:1782727753.181291:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727753.181482:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347628928:0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.181522:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727753.181546:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347629440:0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.181569:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727753.181596:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727753.181602:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347629312:0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.181622:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727753.181649:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347629568 00000100:00100000:1.0:1782727753.181656:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347629568 00000100:00100000:1.0:1782727753.181709:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347629312 00000100:00100000:1.0:1782727753.181713:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347629312 00000100:00100000:1.0:1782727753.181732:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727753.181739:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347629568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.181785:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347629568:12345-0@lo:400:kworker.0 Request processed in 46us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727753.181792:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727753.181808:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727753.181813:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347629312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.181843:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347629312:12345-0@lo:400:kworker.0 Request processed in 30us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727753.181848:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727753.181864:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347628928 00000100:00100000:1.0:1782727753.181867:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347628928 00000100:00100000:1.0:1782727753.181889:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1782727753.181896:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347628928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.181922:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347628928:12345-0@lo:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727753.181941:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1782727753.181970:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727753.181974:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782727753.182001:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4bb800 x1869325347629312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727753.182014:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347629312:0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.182024:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347628928:0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.182065:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347629056 00000100:00100000:1.0:1782727753.182069:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347629056 00000100:00100000:1.0:1782727753.182095:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347629184 00000100:00100000:1.0:1782727753.182098:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347629184 00000100:00100000:1.0:1782727753.182114:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347629440 00000100:00100000:1.0:1782727753.182116:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347629440 00000100:00100000:1.0:1782727753.182131:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782727753.182136:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347629056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.182168:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347629056:12345-0@lo:400:kworker.0 Request processed in 32us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727753.182174:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782727753.182187:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782727753.182192:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325347629184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.182215:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325347629184:12345-0@lo:400:kworker.0 Request processed in 23us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727753.182221:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782727753.182231:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782727753.182235:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347629440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.182274:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347629440:12345-0@lo:400:kworker.0 Request processed in 38us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727753.182280:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1782727753.182296:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727753.182391:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347629440:0@lo:400:kworker.0 00000100:00100000:0.0:1782727753.182498:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727753.182509:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347629696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727753.182542:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1782727753.183718:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4b8000 x1869325347629568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727753.183731:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347629568:0@lo:400:kworker.0 00000100:00100000:2.0:1782727753.183744:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325347629184:0@lo:400:kworker.0 00000100:00100000:2.0:1782727753.183755:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347629056:0@lo:400:kworker.0 00000100:00100000:1.0:1782727753.184401:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347629696 00000100:00100000:1.0:1782727753.184409:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347629696 00000100:00100000:1.0:1782727753.184499:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782727753.184508:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347629696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727753.184537:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727753.184608:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347629696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727753.184615:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1782727753.184710:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcc33e8380 x1869325347629696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727753.184726:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347629696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727753.829268:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727754.207770:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727754.207808:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347629824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727754.207889:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727754.207969:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347629824 00000100:00100000:0.0:1782727754.207976:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347629824 00000100:00100000:0.0:1782727754.208025:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727754.208048:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347629824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727754.208090:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727754.208138:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347629824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727754.208147:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1782727754.208212:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe484380 x1869325347629824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727754.208233:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347629824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727754.843792:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727754.948847:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727754.948906:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329769216 00000100:00100000:0.0:1782727754.948906:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727754.948918:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329769216 00000100:00100000:1.0:1782727754.948998:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 207 00000100:00100000:1.0:1782727754.949011:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329769216:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727754.949105:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329769216:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727754.949113:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 207 00000100:00100000:3.0:1782727754.949666:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329769344 00000100:00100000:3.0:1782727754.949672:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329769344 00000100:00100000:3.0:1782727754.949731:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 64 00000100:00100000:3.0:1782727754.949738:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329769344:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727754.949783:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329769344:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 46us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727754.949789:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 64 00000100:00080000:1.0:1782727754.951155:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727755.867719:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727756.892834:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727757.915877:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727758.300020:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347630080:0@lo:400:kworker.0 00000100:00100000:0.0:1782727758.300096:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727758.300160:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347630592:0@lo:400:kworker.0 00000100:00100000:0.0:1782727758.300185:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727758.300214:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727758.300219:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347630208:0@lo:400:kworker.0 00000100:00100000:0.0:1782727758.300237:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727758.300267:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347630080 00000100:00100000:0.0:1782727758.300276:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347630080 00000100:00100000:0.0:1782727758.300311:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347630208 00000100:00100000:0.0:1782727758.300314:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347630208 00000100:00100000:0.0:1782727758.300338:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782727758.300346:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347630080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727758.300391:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347630080:12345-0@lo:400:kworker.0 Request processed in 45us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727758.300398:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782727758.300413:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782727758.300418:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347630208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727758.300463:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347630208:12345-0@lo:400:kworker.0 Request processed in 46us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727758.300469:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782727758.300523:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347630208:0@lo:400:kworker.0 00000100:00100000:0.0:1782727758.300551:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347630080:0@lo:400:kworker.0 00000100:00100000:3.0:1782727758.300710:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347630336:0@lo:400:kworker.0 00000100:00100000:3.0:1782727758.300743:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727758.300769:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782727758.300775:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347629952:0@lo:400:kworker.0 00000100:00100000:3.0:1782727758.300800:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727758.300823:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347630464:0@lo:400:kworker.0 00000100:00100000:3.0:1782727758.300859:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727758.300883:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347630464 00000100:00100000:3.0:1782727758.300886:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347630464 00000100:00100000:3.0:1782727758.300912:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782727758.300924:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347630464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727758.300954:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347630464:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727758.300960:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782727758.300989:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347629952 00000100:00100000:3.0:1782727758.300992:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347629952 00000100:00100000:3.0:1782727758.301015:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1782727758.301022:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347629952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727758.301050:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347629952:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727758.301055:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1782727758.301088:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347629952:0@lo:400:kworker.0 00000100:00100000:3.0:1782727758.301097:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347630464:0@lo:400:kworker.0 00000100:00100000:1.0:1782727758.301337:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347630592 00000100:00100000:1.0:1782727758.301341:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347630592 00000100:00100000:1.0:1782727758.301366:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347630336 00000100:00100000:1.0:1782727758.301368:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347630336 00000100:00100000:1.0:1782727758.301381:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782727758.301393:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347630592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727758.301458:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347630592:12345-0@lo:400:kworker.0 Request processed in 65us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727758.301464:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782727758.301474:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782727758.301480:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347630336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727758.301522:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347630336:12345-0@lo:400:kworker.0 Request processed in 42us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727758.301528:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1782727758.301542:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727758.301546:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727758.301549:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782727758.301571:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe487480 x1869325347630336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727758.301582:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347630336:0@lo:400:kworker.0 00010000:00080000:3.0:1782727758.301658:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe485880 x1869325347630592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727758.301668:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347630592:0@lo:400:kworker.0 00000100:00100000:3.0:1782727758.301687:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727758.301693:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347630720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727758.301717:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727758.302099:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347630720 00000100:00100000:1.0:1782727758.302104:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347630720 00000100:00100000:1.0:1782727758.302134:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782727758.302141:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347630720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727758.302164:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727758.302215:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347630720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727758.302221:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1782727758.302717:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcf7eed500 x1869325347630720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727758.302735:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347630720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727758.942868:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727759.341419:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347630848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727759.341584:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727759.341758:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347630848 00000100:00100000:2.0:1782727759.341765:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347630848 00000100:00100000:2.0:1782727759.341859:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782727759.341868:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347630848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727759.341896:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727759.350896:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347630848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9017us (9300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727759.354026:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1782727759.360166:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe434e00 x1869325347630848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727759.360193:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347630848:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1782727759.797031:0:10578:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682451 <= 34618625) for LU-18938, skip 360 00010000:00010000:1.0:1782727759.963868:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727760.077405:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727760.077577:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727760.077766:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329769472 00000100:00100000:2.0:1782727760.077777:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329769472 00000100:00100000:2.0:1782727760.077843:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 209 00000100:00100000:2.0:1782727760.077853:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329769472:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727760.078031:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329769600 00000100:00100000:2.0:1782727760.078034:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329769472:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 181us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727760.078035:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329769600 00000100:00100000:2.0:1782727760.078043:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 209 00000100:00100000:1.0:1782727760.078085:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 68 00000100:00100000:1.0:1782727760.078092:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329769600:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727760.078133:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329769600:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 42us (555us total) trans 0 rc 0/0 00000100:00080000:0.0:1782727760.078298:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727760.088997:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 68 00010000:00010000:0.0:1782727760.989226:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727761.983403:0:10627:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682451 < 34486116) for LU-14927, skip 0f 00010000:00010000:1.0:1782727762.012104:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727763.049301:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727763.419799:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347631104:0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.420070:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727763.420126:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347630976:0@lo:400:kworker.0 00000100:00100000:0.0:1782727763.420199:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727763.420228:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347631616:0@lo:400:kworker.0 00000100:00100000:0.0:1782727763.420262:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347631488:0@lo:400:kworker.0 00000100:00100000:0.0:1782727763.420323:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727763.420324:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727763.420380:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727763.420393:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347631360:0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.420396:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727763.420420:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347631232:0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.420573:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347631104 00000100:00100000:3.0:1782727763.420583:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347631104 00000100:00100000:3.0:1782727763.420684:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347631488 00000100:00100000:3.0:1782727763.420691:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347631488 00000100:00100000:3.0:1782727763.420778:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782727763.420796:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347631104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.420905:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347631104:12345-0@lo:400:kworker.0 Request processed in 112us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727763.420919:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782727763.420973:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782727763.420988:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347631488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.421054:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347631488:12345-0@lo:400:kworker.0 Request processed in 68us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727763.421063:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782727763.421126:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347631616 00000100:00100000:3.0:1782727763.421131:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347631616 00000100:00100000:3.0:1782727763.421215:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782727763.421231:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347631616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.421302:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347631616:12345-0@lo:400:kworker.0 Request processed in 74us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727763.421314:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782727763.421503:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347631744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727763.421558:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727763.421660:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347631744 00000100:00100000:3.0:1782727763.421667:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347631744 00000100:00100000:3.0:1782727763.421744:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782727763.421760:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347631744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727763.421797:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727763.421868:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347631744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727763.421880:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1782727763.421962:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe437100 x1869325347631744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727763.421994:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347631744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727763.422080:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727763.422153:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347631104:0@lo:400:kworker.0 00010000:00080000:3.0:1782727763.422185:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe436d80 x1869325347631616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727763.422198:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347631616:0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.422276:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347631232 00000100:00100000:3.0:1782727763.422282:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347631232 00000100:00100000:3.0:1782727763.422360:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782727763.422375:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347631232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.422507:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347631232:12345-0@lo:400:kworker.0 Request processed in 133us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727763.422519:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782727763.422598:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347631232:0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.423728:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347630976 00000100:00100000:3.0:1782727763.423744:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347630976 00000100:00100000:3.0:1782727763.423819:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1782727763.423832:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347630976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.423978:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347630976:12345-0@lo:400:kworker.0 Request processed in 150us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727763.423986:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:0.0:1782727763.425764:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727763.425784:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727763.425891:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727763.425981:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347631360 00000100:00100000:3.0:1782727763.425997:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347631360 00000100:00100000:0.0:1782727763.426001:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347630976:0@lo:400:kworker.0 00000100:00100000:0.0:1782727763.426035:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347631488:0@lo:400:kworker.0 00000100:00080000:0.0:1782727763.426091:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727763.426126:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782727763.426140:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347631360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727763.426239:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347631360:12345-0@lo:400:kworker.0 Request processed in 103us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727763.426247:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1782727763.426410:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe436300 x1869325347631360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727763.426453:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347631360:0@lo:400:kworker.0 00000001:02000400:1.0:1782727763.669594:0:10675:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682451 < 34681754) for LU-12550, skip 216 00010000:00010000:1.0:1782727764.060772:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727764.443826:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727764.443904:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347631872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727764.444004:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727764.444153:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347631872 00000100:00100000:3.0:1782727764.444162:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347631872 00000100:00100000:3.0:1782727764.444217:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782727764.444227:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347631872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727764.444258:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727764.444311:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347631872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727764.444319:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1782727764.444452:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe437480 x1869325347631872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727764.444470:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347631872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727765.083758:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727765.090192:0:10723:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 00000100:00100000:0.0:1782727765.188351:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727765.188413:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727765.192984:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329769728 00000100:00100000:3.0:1782727765.193003:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329769728 00000100:00100000:3.0:1782727765.193131:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 211 00000100:00100000:3.0:1782727765.193143:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329769728:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727765.193261:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329769728:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 119us (4919us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727765.193269:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 211 00000100:00100000:3.0:1782727765.193305:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329769856 00000100:00100000:3.0:1782727765.193309:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329769856 00000100:00100000:3.0:1782727765.193340:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 72 00000100:00100000:3.0:1782727765.193346:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329769856:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727765.193387:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329769856:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 40us (4974us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727765.193393:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 72 00000100:00080000:0.0:1782727765.193672:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782727766.108209:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727766.780409:0:10771:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51c 51e 834 00010000:00010000:0.0:1782727767.131606:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727768.107083:0:10819:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 06:09:26 (1782727766) === 00010000:00010000:1.0:1782727768.160366:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727768.540002:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727768.540030:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347632000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727768.540105:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727768.540194:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347632000 00000100:00100000:0.0:1782727768.540203:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347632000 00000100:00100000:0.0:1782727768.540266:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782727768.540276:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347632000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727768.540408:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727768.540489:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347632000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 214us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727768.540497:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1782727768.540520:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782727768.540552:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe436d80 x1869325347632000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727768.540571:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347632000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727768.544136:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727768.544209:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727768.544230:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347632256:0@lo:400:kworker.0 00000100:00100000:0.0:1782727768.544328:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727768.544401:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347632256 00000100:00100000:0.0:1782727768.544409:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347632256 00000100:00100000:0.0:1782727768.544488:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782727768.544497:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347632256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727768.544550:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347632256:12345-0@lo:400:kworker.0 Request processed in 53us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727768.544556:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782727768.544601:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347632256:0@lo:400:kworker.0 00000100:00100000:1.0:1782727768.547996:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347632128:0@lo:400:kworker.0 00000100:00100000:1.0:1782727768.548078:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727768.548302:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347632128 00000100:00100000:3.0:1782727768.548310:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347632128 00000100:00100000:3.0:1782727768.548377:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1782727768.548386:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347632128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727768.548472:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347632128:12345-0@lo:400:kworker.0 Request processed in 87us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727768.548479:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1782727768.548525:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347632128:0@lo:400:kworker.0 00000100:00100000:2.0:1782727768.552820:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347632384:0@lo:400:kworker.0 00000100:00100000:2.0:1782727768.552895:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727768.552932:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727768.552939:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347632512:0@lo:400:kworker.0 00000100:00100000:2.0:1782727768.552965:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727768.552998:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347632384 00000100:00100000:2.0:1782727768.553006:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347632384 00000100:00100000:2.0:1782727768.553063:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782727768.553072:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347632384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727768.553123:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347632384:12345-0@lo:400:kworker.0 Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727768.553130:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782727768.553153:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347632512 00000100:00100000:2.0:1782727768.553156:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347632512 00000100:00100000:2.0:1782727768.553183:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782727768.553189:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347632512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727768.553220:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347632512:12345-0@lo:400:kworker.0 Request processed in 32us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727768.553227:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1782727768.553253:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782727768.553258:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782727768.553300:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4b9c00 x1869325347632512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727768.553326:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347632512:0@lo:400:kworker.0 00000100:00100000:2.0:1782727768.553340:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347632384:0@lo:400:kworker.0 00000100:00100000:1.0:1782727768.553452:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347632640:0@lo:400:kworker.0 00000100:00100000:1.0:1782727768.553483:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727768.554235:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347632640 00000100:00100000:2.0:1782727768.554242:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347632640 00000100:00100000:2.0:1782727768.554298:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782727768.554305:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347632640:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782727768.554411:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727768.554560:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347632640:12345-0@lo:400:kworker.0 Request processed in 254us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727768.554566:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782727768.556227:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347632640:0@lo:400:kworker.0 00010000:00010000:0.0:1782727769.179647:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727769.565762:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347632768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727769.565831:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727769.565998:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347632768 00000100:00100000:0.0:1782727769.566005:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347632768 00000100:00100000:0.0:1782727769.566055:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782727769.566063:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347632768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727769.566091:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727769.566143:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347632768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727769.566150:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1782727769.566324:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe437b80 x1869325347632768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727769.566344:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347632768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782727770.204263:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727770.308253:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727770.308372:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727770.308492:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329770112 00000100:00100000:1.0:1782727770.308513:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329770112 00000100:00100000:1.0:1782727770.308613:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 76 00000100:00100000:1.0:1782727770.308625:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2350:x1869325329770112:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727770.308728:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2350:x1869325329770112:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 105us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727770.308737:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 76 00000100:00080000:1.0:1782727770.308776:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727770.319902:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329769984 00000100:00100000:0.0:1782727770.319929:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329769984 00000100:00100000:0.0:1782727770.321050:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 213 00000100:00100000:0.0:1782727770.321069:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329769984:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727770.321193:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329769984:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 130us (12820us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727770.321202:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 213 00010000:00010000:0.0:1782727771.227695:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727772.251784:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727773.093641:0:11012:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1782727773.275975:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727773.659689:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727773.659728:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347632896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727773.659823:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727773.659913:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347632896 00000100:00100000:0.0:1782727773.659924:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347632896 00000100:00100000:0.0:1782727773.660006:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782727773.660017:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347632896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727773.660054:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727773.660112:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347632896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727773.660121:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1782727773.660170:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe436680 x1869325347632896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727773.660188:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347632896:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782727773.660491:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727773.665090:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347633408:0@lo:400:kworker.0 00000100:00100000:1.0:1782727773.665159:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727773.665227:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782727773.665244:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347633024:0@lo:400:kworker.0 00000100:00100000:1.0:1782727773.665273:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727773.665296:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347633536:0@lo:400:kworker.0 00000100:00100000:0.0:1782727773.665299:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347633024 00000100:00100000:0.0:1782727773.665307:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347633024 00000100:00100000:1.0:1782727773.665318:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727773.665354:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1782727773.665363:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347633024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727773.665384:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347633152:0@lo:400:kworker.0 00000100:00100000:3.0:1782727773.665408:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727773.665418:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347633024:12345-0@lo:400:kworker.0 Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727773.665443:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727773.665448:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347633280:0@lo:400:kworker.0 00000100:00100000:3.0:1782727773.665474:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727773.665505:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347633408 00000100:00100000:3.0:1782727773.665508:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347633408 00000100:00100000:3.0:1782727773.665544:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727773.665552:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347633408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727773.665584:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347633408:12345-0@lo:400:kworker.0 Request processed in 34us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727773.665591:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727773.665614:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347633536 00000100:00100000:3.0:1782727773.665618:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347633536 00000100:00100000:3.0:1782727773.665644:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347633152 00000100:00100000:3.0:1782727773.665647:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347633152 00000100:00100000:3.0:1782727773.665657:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347633280 00000100:00100000:3.0:1782727773.665659:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347633280 00000100:00100000:3.0:1782727773.665672:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782727773.665677:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347633536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727773.665707:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347633536:12345-0@lo:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727773.665739:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782727773.665752:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782727773.665769:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347633152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727773.665802:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347633152:12345-0@lo:400:kworker.0 Request processed in 44us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727773.665808:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782727773.665820:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782727773.665827:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347633280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727773.665854:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347633280:12345-0@lo:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727773.665859:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782727773.665908:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347633280:0@lo:400:kworker.0 00000100:00100000:3.0:1782727773.665918:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347633152:0@lo:400:kworker.0 00000100:00080000:3.0:1782727773.665940:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727773.665944:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727773.672969:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347633024:0@lo:400:kworker.0 00000100:00100000:1.0:1782727773.672986:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347633536:0@lo:400:kworker.0 00010000:00080000:1.0:1782727773.672997:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe436d80 x1869325347633408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727773.673005:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347633408:0@lo:400:kworker.0 00000100:00100000:0.0:1782727773.674321:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00010000:00010000:2.0:1782727774.304978:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727774.683696:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727774.683736:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347633664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727774.684359:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727774.684533:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347633664 00000100:00100000:3.0:1782727774.684550:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347633664 00000100:00100000:3.0:1782727774.684653:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782727774.684677:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347633664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727774.684740:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727774.684846:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347633664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727774.684854:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1782727774.684943:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe434000 x1869325347633664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727774.684997:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347633664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727775.325659:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727775.425051:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727775.426891:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329770368 00000100:00100000:1.0:1782727775.426914:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329770368 00000100:00100000:1.0:1782727775.426999:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 80 00000100:00100000:1.0:1782727775.427011:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329770368:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727775.427108:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329770368:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 98us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727775.427115:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 80 00000100:00100000:3.0:1782727775.427542:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00080000:3.0:1782727775.427570:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727775.427599:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329770240 00000100:00100000:1.0:1782727775.427605:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329770240 00000100:00100000:1.0:1782727775.427657:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 215 00000100:00100000:1.0:1782727775.427665:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2352:x1869325329770240:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727775.427702:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2352:x1869325329770240:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 38us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727775.427709:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 215 00010000:00010000:0.0:1782727776.355399:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727777.371660:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727778.395730:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727778.779746:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727778.779766:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347633792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727778.779838:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727778.779986:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347633792 00000100:00100000:3.0:1782727778.779995:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347633792 00000100:00100000:3.0:1782727778.780069:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782727778.780081:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347633792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727778.780118:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727778.780173:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347633792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727778.780181:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1782727778.780230:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe436680 x1869325347633792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727778.780253:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347633792:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782727778.780742:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727778.780858:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347633920:0@lo:400:kworker.0 00000100:00100000:1.0:1782727778.780908:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727778.780983:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347633920 00000100:00100000:0.0:1782727778.780990:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347633920 00000100:00100000:0.0:1782727778.781045:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1782727778.781054:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347633920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727778.781213:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347634048:0@lo:400:kworker.0 00000100:00100000:2.0:1782727778.781245:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727778.781325:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347633920:12345-0@lo:400:kworker.0 Request processed in 272us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727778.781332:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1782727778.781463:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347634048 00000100:00100000:3.0:1782727778.781467:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347634048 00000100:00100000:3.0:1782727778.781500:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727778.781507:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347634048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727778.781543:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347634048:12345-0@lo:400:kworker.0 Request processed in 36us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727778.781549:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727778.781586:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347634048:0@lo:400:kworker.0 00000100:00100000:3.0:1782727778.781598:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727778.781619:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347634432:0@lo:400:kworker.0 00000100:00100000:3.0:1782727778.781659:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727778.781686:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347634432 00000100:00100000:3.0:1782727778.781690:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347634432 00000100:00100000:3.0:1782727778.781720:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782727778.781726:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347634432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727778.781761:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347634432:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727778.781767:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1782727778.781782:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727778.781799:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347634432:0@lo:400:kworker.0 00000100:00100000:2.0:1782727778.781868:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347634304:0@lo:400:kworker.0 00000100:00100000:2.0:1782727778.781914:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727778.781941:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727778.781947:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325347634176:0@lo:400:kworker.0 00000100:00100000:2.0:1782727778.781969:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727778.782279:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347634304 00000100:00100000:3.0:1782727778.782284:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347634304 00000100:00100000:3.0:1782727778.782323:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782727778.782330:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347634304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727778.782366:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347634304:12345-0@lo:400:kworker.0 Request processed in 37us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727778.782372:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782727778.782389:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347634176 00000100:00100000:3.0:1782727778.782392:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347634176 00000100:00100000:3.0:1782727778.782412:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782727778.782417:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325347634176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727778.782462:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325347634176:12345-0@lo:400:kworker.0 Request processed in 45us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727778.782468:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782727778.782492:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325347634176:0@lo:400:kworker.0 00010000:00080000:3.0:1782727778.782513:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe436d80 x1869325347634304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727778.782524:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347634304:0@lo:400:kworker.0 00000100:00080000:2.0:1782727778.782579:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727778.782582:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727778.784657:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347633920:0@lo:400:kworker.0 00000020:00000004:3.0:1782727779.305129:0:11274:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727779.305742:0:11274:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727779.425596:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727779.804186:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347634560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727779.804271:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727779.804356:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347634560 00000100:00100000:3.0:1782727779.804364:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347634560 00000100:00100000:3.0:1782727779.804420:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782727779.804447:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347634560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727779.804489:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727779.804537:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347634560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727779.804544:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1782727779.804581:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe436d80 x1869325347634560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727779.804598:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347634560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727780.443612:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727780.546016:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727780.546144:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727780.546268:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329770496 00000100:00100000:1.0:1782727780.546281:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329770496 00000100:00100000:1.0:1782727780.546348:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 217 00000100:00100000:1.0:1782727780.546361:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329770496:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727780.546504:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329770496:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 146us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727780.546512:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 217 00000100:00100000:0.0:1782727780.549217:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329770624 00000100:00100000:0.0:1782727780.549239:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329770624 00000100:00100000:1.0:1782727780.553264:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 84 00000100:00100000:1.0:1782727780.553280:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329770624:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727780.553400:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329770624:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 123us (7254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727780.553408:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 84 00000100:00080000:2.0:1782727780.558573:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:1.0:1782727781.260328:0:11371:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727781.260842:0:11371:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727781.467765:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727782.492147:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727783.517058:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782727783.555985:0:11469:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727783.556259:0:11469:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782727783.902462:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347634816:0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.902577:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727783.902634:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347634816 00000100:00100000:0.0:1782727783.902645:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347634816 00000100:00100000:3.0:1782727783.902660:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347635328:0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.902697:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727783.902709:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1782727783.902721:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347634816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.902747:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782727783.902756:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347634688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727783.902788:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347634816:12345-0@lo:400:kworker.0 Request processed in 68us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727783.902798:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727783.902802:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1782727783.902828:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347635200:0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.902883:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727783.902927:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347635200 00000100:00100000:0.0:1782727783.902932:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347635200 00000100:00100000:3.0:1782727783.902941:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347634816:0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.902983:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347634944:0@lo:400:kworker.0 00000100:00100000:0.0:1782727783.902993:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782727783.903002:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347635200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.903019:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727783.903045:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347635456:0@lo:400:kworker.0 00000100:00100000:0.0:1782727783.903072:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347635200:12345-0@lo:400:kworker.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727783.903086:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782727783.903092:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727783.903115:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727783.903126:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347635072:0@lo:400:kworker.0 00000100:00080000:1.0:1782727783.903141:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727783.903153:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727783.903180:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347635328 00000100:00100000:1.0:1782727783.903186:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347635328 00000100:00100000:3.0:1782727783.903192:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347634944 00000100:00100000:3.0:1782727783.903198:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347634944 00000100:00100000:1.0:1782727783.903234:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347635072 00000100:00100000:1.0:1782727783.903239:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347635072 00000100:00100000:3.0:1782727783.903821:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782727783.903831:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347635328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.903881:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347635328:12345-0@lo:400:kworker.0 Request processed in 53us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727783.903887:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782727783.903902:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782727783.903908:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347634944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.903940:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347634944:12345-0@lo:400:kworker.0 Request processed in 32us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727783.903946:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782727783.903968:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782727783.903975:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347635072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.904003:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347635072:12345-0@lo:400:kworker.0 Request processed in 29us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727783.904346:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782727783.904471:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347635456 00000100:00100000:3.0:1782727783.904478:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347635456 00000100:00100000:3.0:1782727783.904526:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1782727783.904526:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727783.904538:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347635456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.904580:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347635456:12345-0@lo:400:kworker.0 Request processed in 45us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727783.904844:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727783.904908:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347635072:0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.904924:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347634944:0@lo:400:kworker.0 00010000:00080000:3.0:1782727783.904937:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77f8700 x1869325347635456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727783.904947:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347635456:0@lo:400:kworker.0 00010000:00080000:3.0:1782727783.904997:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77f9180 x1869325347635200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727783.905008:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347635200:0@lo:400:kworker.0 00000100:00100000:3.0:1782727783.905021:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347635328:0@lo:400:kworker.0 00000100:00080000:0.0:1782727783.905466:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727783.906736:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347634688 00000100:00100000:2.0:1782727783.906753:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347634688 00000100:00100000:2.0:1782727783.906865:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782727783.906877:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347634688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727783.906938:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727783.907053:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347634688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (4257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727783.907078:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1782727783.907169:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe437480 x1869325347634688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727783.907193:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347634688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782727784.545914:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727784.923671:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347635584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727784.923743:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727784.923881:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347635584 00000100:00100000:2.0:1782727784.923889:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347635584 00000100:00100000:2.0:1782727784.923946:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782727784.923955:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347635584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727784.923985:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727784.928250:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347635584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4282us (4493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727784.928267:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1782727784.933807:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4d9500 x1869325347635584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727784.933879:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347635584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727785.563617:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727785.674402:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727785.674478:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727785.674509:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329770880 00000100:00100000:2.0:1782727785.674518:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329770880 00000100:00100000:2.0:1782727785.674586:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 88 00000100:00100000:2.0:1782727785.674596:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329770880:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727785.674683:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329770880:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727785.674691:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 88 00000100:00100000:2.0:1782727785.674718:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329770752 00000100:00100000:2.0:1782727785.674722:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329770752 00000100:00100000:2.0:1782727785.674748:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 219 00000100:00100000:2.0:1782727785.674755:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329770752:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727785.674804:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329770752:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 49us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727785.674811:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 219 00000100:00080000:1.0:1782727785.675177:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:2.0:1782727785.801388:0:11566:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727785.802075:0:11566:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727786.588646:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727787.616590:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727788.635865:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727789.020618:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347635840:0@lo:400:kworker.0 00000100:00100000:2.0:1782727789.020719:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727789.020799:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347636352:0@lo:400:kworker.0 00000100:00100000:2.0:1782727789.020828:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727789.020869:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782727789.020876:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347635712:0@lo:400:kworker.0 00000100:00100000:2.0:1782727789.020903:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727789.020926:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347636224:0@lo:400:kworker.0 00000100:00100000:2.0:1782727789.020946:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727789.020985:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347636352 00000100:00100000:2.0:1782727789.020993:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347636352 00000100:00100000:2.0:1782727789.021057:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782727789.021067:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347636352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727789.021121:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347636352:12345-0@lo:400:kworker.0 Request processed in 56us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727789.021128:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782727789.021150:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347635712 00000100:00100000:2.0:1782727789.021154:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347635712 00000100:00100000:2.0:1782727789.021177:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1782727789.021184:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347635712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727789.021222:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347635712:12345-0@lo:400:kworker.0 Request processed in 39us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727789.021228:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:2.0:1782727789.021253:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727789.021282:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347635712:0@lo:400:kworker.0 00010000:00080000:2.0:1782727789.021311:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77fe680 x1869325347636352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727789.021322:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347636352:0@lo:400:kworker.0 00000100:00100000:0.0:1782727789.021496:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347635840 00000100:00100000:0.0:1782727789.021501:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347635840 00000100:00100000:0.0:1782727789.021539:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347636224 00000100:00100000:0.0:1782727789.021543:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347636224 00000100:00100000:0.0:1782727789.021567:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782727789.021574:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347635840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727789.021614:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347635840:12345-0@lo:400:kworker.0 Request processed in 41us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727789.021620:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782727789.021633:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782727789.021639:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347636224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727789.021665:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347636224:12345-0@lo:400:kworker.0 Request processed in 27us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727789.021671:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1782727789.021862:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727789.021883:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347636224:0@lo:400:kworker.0 00000100:00100000:2.0:1782727789.021895:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347635840:0@lo:400:kworker.0 00000100:00100000:3.0:1782727789.022010:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347635968:0@lo:400:kworker.0 00000100:00100000:3.0:1782727789.022043:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727789.022070:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347636480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727789.022092:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727789.022118:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727789.022124:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347636096:0@lo:400:kworker.0 00000100:00100000:3.0:1782727789.022144:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727789.022223:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347636480 00000100:00100000:1.0:1782727789.022227:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347636480 00000100:00100000:1.0:1782727789.022264:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782727789.022272:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347636480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727789.022306:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727789.022346:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347636480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727789.022353:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727789.022483:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347636096 00000100:00100000:2.0:1782727789.022487:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347636096 00000100:00100000:2.0:1782727789.022529:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782727789.022536:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347636096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727789.022569:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347636096:12345-0@lo:400:kworker.0 Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727789.022575:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1782727789.022686:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727789.022833:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe437480 x1869325347636096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727789.022845:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347636096:0@lo:400:kworker.0 00010000:00080000:3.0:1782727789.022855:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4d9500 x1869325347636480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727789.022867:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347636480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727789.023056:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347635968 00000100:00100000:0.0:1782727789.023061:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347635968 00000100:00100000:0.0:1782727789.023109:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782727789.023127:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347635968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727789.023170:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347635968:12345-0@lo:400:kworker.0 Request processed in 44us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727789.023176:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1782727789.023232:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727789.023282:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347635968:0@lo:400:kworker.0 00000001:02000400:3.0:1782727789.196446:0:11710:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782727789.660226:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727790.044802:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727790.044836:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347636608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727790.044941:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727790.045632:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347636608 00000100:00100000:3.0:1782727790.045645:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347636608 00000100:00100000:3.0:1782727790.045735:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782727790.045745:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347636608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727790.045784:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727790.045856:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347636608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727790.045865:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1782727790.046051:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4d9500 x1869325347636608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727790.046104:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347636608:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782727790.686755:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727790.783290:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727790.783343:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727790.783445:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329771136 00000100:00100000:1.0:1782727790.783456:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329771136 00000100:00100000:1.0:1782727790.783558:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 92 00000100:00100000:1.0:1782727790.783571:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329771136:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727790.783686:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329771136:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 110us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727790.783696:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 92 00000100:00080000:0.0:1782727790.783933:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727790.787156:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329771008 00000100:00100000:2.0:1782727790.787176:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329771008 00000100:00100000:2.0:1782727790.787268:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 221 00000100:00100000:2.0:1782727790.787279:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329771008:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727790.787364:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329771008:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 86us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727790.787373:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 221 00010000:00010000:2.0:1782727791.707718:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782727792.669837:0:11858:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe02659cb0 20000000:00000080:0.0:1782727792.669855:0:11858:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91fcfe383c00 uarg=0000000000000000 20000000:01000000:0.0:1782727792.669898:0:11858:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782727792.669905:0:11858:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782727792.669910:0:11858:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782727792.670377:0:11859:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1782727792.670785:0:11858:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782727792.678898:0:11858:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782727792.678938:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.678954:0:11858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcd346cc00/0xb393e873fab6440b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64404 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.678962:0:11858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcf3a76800/0xb393e873fab64435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab6442e expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.678968:0:11858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6445f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64458 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.678978:0:11858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91fcd346dc00/0xb393e873fab64474 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bab expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.678985:0:11858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.679043:0:11858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcd346dc00/0xb393e873fab64474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bab expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.679057:0:11858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91fcd346dc00/0xb393e873fab64474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bab expref: 9 pid: 5944 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727792.679073:0:11858:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11858:1869325347636736:192.168.201.8@tcp:104: 00010000:00010000:0.0:1782727792.679263:0:11858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6445f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64458 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.679271:0:11858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6445f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64458 expref: 18 pid: 5944 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727792.679280:0:11858:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11858:1869325347636864:0@lo:104: 00000100:00100000:0.0:1782727792.679323:0:11858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727792.679373:0:11858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcf3a76800/0xb393e873fab64435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab6442e expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.679382:0:11858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcf3a76800/0xb393e873fab64435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab6442e expref: 18 pid: 5944 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727792.679390:0:11858:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11858:1869325347636992:0@lo:104: 00000100:00100000:1.0:1782727792.679494:0:8874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347636864 00000100:00100000:1.0:1782727792.679502:0:8874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347636864 00000100:00100000:1.0:1782727792.679550:0:8874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727792.679559:0:8874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:11858:x1869325347636864:12345-0@lo:104: 00010000:00010000:1.0:1782727792.679572:0:8874:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.679619:0:8874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727792.679625:0:8874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:11858:x1869325347636864:12345-0@lo:104: Request processed in 68us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727792.679632:0:8874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1782727792.679656:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727792.679662:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.679669:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346d200 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:1.0:1782727792.679673:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.679681:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727792.679687:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727792.679693:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727792.679745:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.679753:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727792.679774:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.679782:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcd346d200/0xb393e873fab64458 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6445f expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.679794:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727792.679795:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727792.679796:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727792.679815:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347637120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727792.679847:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727792.679973:0:11858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727792.679996:0:11858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91fcd346cc00/0xb393e873fab6440b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb393e873fab64404 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.680004:0:11858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91fcd346cc00/0xb393e873fab6440b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb393e873fab64404 expref: 18 pid: 5945 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727792.680024:0:11858:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11858:1869325347637248:0@lo:104: 00000100:00100000:0.0:1782727792.680046:0:11858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727792.680059:0:11858:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcfe467180 going to sleep for 11 seconds 00000100:00100000:0.0:1782727792.680077:0:11858:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11858:1869325347636864:0@lo:104: 00000100:00100000:1.0:1782727792.680135:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347636992 00000100:00100000:1.0:1782727792.680140:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347636992 00000100:00100000:1.0:1782727792.680170:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347637248 00000100:00100000:1.0:1782727792.680173:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347637248 00000100:00100000:1.0:1782727792.680185:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727792.680191:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:11858:x1869325347636992:12345-0@lo:104: 00010000:00010000:1.0:1782727792.680199:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680234:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727792.680239:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+4:11858:x1869325347636992:12345-0@lo:104: Request processed in 49us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727792.680245:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727792.680255:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782727792.680260:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:11858:x1869325347637248:12345-0@lo:104: 00010000:00010000:1.0:1782727792.680273:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680298:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782727792.680303:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+3:11858:x1869325347637248:12345-0@lo:104: Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727792.680309:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1782727792.680322:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782727792.680327:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680333:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76400 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:1.0:1782727792.680337:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680344:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727792.680351:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727792.680357:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727792.680373:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680379:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727792.680389:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680407:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcf3a76400/0xb393e873fab6442e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab64435 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680444:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727792.680447:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680453:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc0030a00 already unused, calling callback (ffffffffc1215c20) 10000000:00010000:1.0:1782727792.680455:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680461:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727792.680467:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727792.680472:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727792.680484:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680490:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727792.680505:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680511:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff91fcc0030a00/0xb393e873fab64404 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb393e873fab6440b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680523:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727792.680525:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727792.680526:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727792.680531:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727792.680549:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347637376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727792.680575:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727792.680604:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347637504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727792.680623:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727792.680649:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347637120 00000100:00100000:1.0:1782727792.680653:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347637120 00010000:00010000:1.0:1782727792.680671:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6445f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64458 expref: 19 pid: 5944 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727792.680685:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347637376 00000100:00100000:1.0:1782727792.680688:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347637376 00010000:00010000:1.0:1782727792.680696:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcf3a76800/0xb393e873fab64435 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab6442e expref: 20 pid: 5944 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727792.680705:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347637504 00000100:00100000:1.0:1782727792.680707:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347637504 00010000:00010000:1.0:1782727792.680716:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcd346cc00/0xb393e873fab6440b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64404 expref: 21 pid: 5945 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727792.680727:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727792.680732:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcde699c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+21:3444:x1869325347637120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727792.680742:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727792.680747:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6445f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64458 expref: 21 pid: 5944 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680756:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6445f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64458 expref: 21 pid: 5944 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680770:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcf3a76000/0xb393e873fab6445f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64458 expref: 21 pid: 5944 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680791:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727792.680816:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcde699c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+20:3444:x1869325347637120:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727792.680822:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727792.680859:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727792.680865:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347637376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727792.680872:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727792.680876:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcf3a76800/0xb393e873fab64435 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab6442e expref: 19 pid: 5944 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680884:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcf3a76800/0xb393e873fab64435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab6442e expref: 19 pid: 5944 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680893:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727792.680926:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347637376:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727792.680932:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727792.680942:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727792.680948:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:3442:x1869325347637504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727792.680954:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727792.680958:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcd346cc00/0xb393e873fab6440b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb393e873fab64404 expref: 18 pid: 5945 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680966:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcd346cc00/0xb393e873fab6440b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb393e873fab64404 expref: 18 pid: 5945 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.680975:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727792.681001:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:3442:x1869325347637504:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727792.681008:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727792.681036:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347637120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727792.681057:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347637376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727792.681072:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347637504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782727792.682780:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcf3a76800/0xb393e873fab64435 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab6442e expref: 17 pid: 5944 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727792.682799:0:11858:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11858:1869325347636992:0@lo:104: 00010000:00010000:0.0:1782727792.682811:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcd346cc00/0xb393e873fab6440b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb393e873fab64404 expref: 16 pid: 5945 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727792.682820:0:11858:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11858:1869325347637248:0@lo:104: 00000100:00100000:2.0:1782727792.685484:0:11858:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11858:1869325347636736:192.168.201.8@tcp:104: 00010000:00010000:2.0:1782727792.685527:0:11858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727792.686248:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727792.686313:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329771264 00000100:00100000:1.0:1782727792.686320:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329771264 00010000:00010000:1.0:1782727792.686360:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91fcd346dc00/0xb393e873fab64474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bab expref: 10 pid: 5944 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727792.686401:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:1.0:1782727792.686410:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329771264:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782727792.686538:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727792.686544:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91fcd346dc00/0xb393e873fab64474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bab expref: 10 pid: 5944 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.686557:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91fcd346dc00/0xb393e873fab64474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bab expref: 10 pid: 5944 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.686577:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcd346dc00/0xb393e873fab64474 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bab expref: 10 pid: 5944 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.686595:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.686603:0:5938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.686633:0:5938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.686640:0:5938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.686646:0:5938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.686653:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.686659:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc147fc00 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:1.0:1782727792.686664:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.686672:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.687112:0:11858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727792.687121:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.688210:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.688227:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91fcc147fc00/0xb393e873fab6447b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727792.688247:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727792.688382:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3a2b312-3952-4d62-a958-96e4c68c622a+9:2351:x1869325329771264:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 1968us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727792.688403:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 28 00010000:00010000:2.0:1782727792.731822:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727793.762501:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727793.859669:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727793.859749:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329771392 00000100:00100000:1.0:1782727793.859759:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329771392 00000100:00100000:1.0:1782727793.859822:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 222 00000100:00100000:1.0:1782727793.859832:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+9:5441:x1869325329771392:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727793.859850:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727793.859872:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcc567a000/0xb393e873fab64482 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bb2 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727793.859910:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcc567a000/0xb393e873fab64482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bb2 expref: 10 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727793.859923:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcc567a000/0xb393e873fab64482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bb2 expref: 10 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727793.859932:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567a000, rc 0) 00000100:00100000:1.0:1782727793.859998:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329771392:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 167us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727793.860006:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 222 00000100:00100000:3.0:1782727793.863060:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727793.863321:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329771520 00000100:00100000:1.0:1782727793.863331:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329771520 00000100:00100000:1.0:1782727793.863541:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 223 00000100:00100000:1.0:1782727793.863552:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329771520:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727793.864606:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329771520:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 1052us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727793.864617:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 223 00000100:00100000:3.0:1782727793.872831:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727793.873055:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329771648 00000100:00100000:0.0:1782727793.873069:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329771648 00000100:00100000:0.0:1782727793.873138:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 224 00000100:00100000:0.0:1782727793.873150:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329771648:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727793.873309:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:5441:x1869325329771648:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 161us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727793.873319:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 224 00000100:00100000:2.0:1782727794.142331:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347638016:0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.142405:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727794.142499:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782727794.142505:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347637632:0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.142536:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727794.142561:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347638144:0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.142602:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727794.142633:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347637760:0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.142661:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727794.142685:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347638272:0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.142707:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727794.142726:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727794.142731:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347637888:0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.142752:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727794.142781:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347638016 00000100:00100000:2.0:1782727794.142788:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347638016 00000100:00100000:2.0:1782727794.142841:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347638272 00000100:00100000:2.0:1782727794.142845:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347638272 00000100:00100000:2.0:1782727794.142864:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782727794.142873:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347638016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.142938:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347638016:12345-0@lo:400:kworker.0 Request processed in 65us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727794.142946:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782727794.142963:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782727794.142969:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347638272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.143001:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347638272:12345-0@lo:400:kworker.0 Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727794.143006:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782727794.143024:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347637632 00000100:00100000:2.0:1782727794.143028:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347637632 00000100:00100000:2.0:1782727794.143056:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1782727794.143062:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3442:x1869325347637632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.143094:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:3442:x1869325347637632:12345-0@lo:400:kworker.0 Request processed in 32us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727794.143099:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1782727794.143134:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347638144 00000100:00100000:2.0:1782727794.143145:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347638144 00000100:00100000:2.0:1782727794.143174:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347637760 00000100:00100000:2.0:1782727794.143177:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347637760 00000100:00100000:2.0:1782727794.143188:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347637888 00000100:00100000:2.0:1782727794.143190:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347637888 00000100:00100000:2.0:1782727794.143205:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782727794.143211:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347638144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.143242:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347638144:12345-0@lo:400:kworker.0 Request processed in 32us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727794.143248:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782727794.143260:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782727794.143265:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347637760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.143292:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347637760:12345-0@lo:400:kworker.0 Request processed in 26us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727794.143298:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782727794.143308:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782727794.143314:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347637888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.143337:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347637888:12345-0@lo:400:kworker.0 Request processed in 24us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727794.143342:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1782727794.143366:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727794.143371:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727794.143372:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727794.143409:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347637888:0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.143419:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347637760:0@lo:400:kworker.0 00010000:00080000:2.0:1782727794.143452:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcd77f8700 x1869325347638272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727794.143473:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347638272:0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.143504:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347637632:0@lo:400:kworker.0 00000100:00100000:2.0:1782727794.143514:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347638144:0@lo:400:kworker.0 00010000:00080000:2.0:1782727794.143524:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4bb800 x1869325347638016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727794.143532:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347638016:0@lo:400:kworker.0 00000100:00100000:0.0:1782727794.147991:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347638400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727794.148108:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727794.148253:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347638400 00000100:00100000:2.0:1782727794.148264:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347638400 00000100:00100000:2.0:1782727794.148341:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782727794.148350:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347638400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727794.148380:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727794.152352:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347638400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3991us (4232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727794.152367:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1782727794.156337:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4d5500 x1869325347638400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727794.156388:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347638400:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1782727794.395509:0:5948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727794.395517:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91fcfde9a000 from 7 10000000:01000000:1.0:1782727794.395522:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727794.395573:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727794.395586:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727794.395597:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727794.395627:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347638528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.395702:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727794.395780:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0618300 going to sleep for 11 seconds 00000100:00100000:3.0:1782727794.395941:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347638528 00000100:00100000:3.0:1782727794.395949:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347638528 00000100:00100000:3.0:1782727794.396005:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1782727794.396015:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+16:5948:x1869325347638528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727794.396029:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727794.396041:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcd346d800/0xb393e873fab64490 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64489 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727794.396065:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcd346d800/0xb393e873fab64490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64489 expref: 17 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727794.396075:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcd346d800/0xb393e873fab64490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64489 expref: 17 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727794.396084:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346d800, rc 0) 00000100:00100000:3.0:1782727794.396130:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347638528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727794.396136:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782727794.396244:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347638528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727794.396259:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64489 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64490 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727794.396268:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64489 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab64490 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727794.396333:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347638656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727794.396362:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727794.396386:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcfe467c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727794.396499:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347638656 00000100:00100000:3.0:1782727794.396503:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347638656 00000100:00100000:3.0:1782727794.396537:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1782727794.396544:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347638656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727794.396803:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347638656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727794.396810:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1782727794.397264:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347638656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.397310:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347638784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.397354:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727794.397668:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0618480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727794.401298:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347638784 00000100:00100000:0.0:1782727794.401312:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347638784 00000100:00100000:0.0:1782727794.401408:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1782727794.401444:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347638784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727794.401634:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347638784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (4278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727794.401643:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782727794.401764:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347638784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782727794.403174:0:11914:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782727794.403494:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782727794.403526:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782727794.403540:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64489 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64490 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727794.403553:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc567be00/0xb393e873fab64489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab64490 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727794.403581:0:5948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782727794.403584:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91fcf9d2c000 from 7 10000000:01000000:0.0:1782727794.403587:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782727794.403740:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc147fa00/0xb393e873fab64497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727794.403749:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc147fa00/0xb393e873fab64497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727794.403761:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc147fa00/0xb393e873fab64497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727794.403785:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347638912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727794.403851:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727794.403979:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcfe4679c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727794.407233:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347638912 00000100:00100000:3.0:1782727794.407261:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347638912 00000100:00100000:3.0:1782727794.407475:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1782727794.407489:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf9f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+17:5948:x1869325347638912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727794.407511:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727794.407532:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcd346c600/0xb393e873fab6449e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab64497 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727794.407567:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcd346c600/0xb393e873fab6449e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab64497 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727794.407582:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcd346c600/0xb393e873fab6449e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab64497 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727794.407591:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346c600, rc 0) 00000100:00100000:3.0:1782727794.407687:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf9f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347638912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727794.407694:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1782727794.407810:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347638912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727794.407829:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc147fa00/0xb393e873fab64497 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6449e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727794.407852:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc147fa00/0xb393e873fab64497 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab6449e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727794.407956:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347639040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.407998:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727794.408588:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0618180 going to sleep for 11 seconds 00000100:00100000:0.0:1782727794.409108:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347639040 00000100:00100000:0.0:1782727794.409118:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347639040 00000100:00100000:1.0:1782727794.409254:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782727794.409263:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fce3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347639040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.409506:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fce3620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347639040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727794.409515:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1782727794.409753:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347639040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.409875:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347639168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.409932:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727794.410003:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0618540 going to sleep for 11 seconds 00000100:00100000:0.0:1782727794.410046:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347639168 00000100:00100000:0.0:1782727794.410051:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347639168 00000100:00100000:1.0:1782727794.410135:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1782727794.410142:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347639168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.410276:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347639168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727794.410283:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1782727794.410350:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347639168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782727794.411915:0:11915:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782727794.412134:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782727794.412159:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782727794.412170:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc147fa00/0xb393e873fab64497 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6449e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727794.412182:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc147fa00/0xb393e873fab64497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab6449e expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727794.412282:0:5948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727794.412286:0:5948:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91fcc90cc800 from 7 10000000:01000000:1.0:1782727794.412289:0:5948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727794.412323:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567bc00/0xb393e873fab644a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727794.412342:0:5948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff91fcc567bc00/0xb393e873fab644a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727794.412353:0:5948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff91fcc567bc00/0xb393e873fab644a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727794.412374:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347639296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.414482:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727794.414544:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0618540 going to sleep for 11 seconds 00000100:00100000:3.0:1782727794.414554:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347639296 00000100:00100000:3.0:1782727794.414562:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347639296 00000100:00100000:3.0:1782727794.415627:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782727794.415642:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+18:5948:x1869325347639296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727794.415660:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727794.415677:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91fcd346c400/0xb393e873fab644ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb393e873fab644a5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727794.415704:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91fcd346c400/0xb393e873fab644ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb393e873fab644a5 expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727794.415715:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91fcd346c400/0xb393e873fab644ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb393e873fab644a5 expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727794.415731:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346c400, rc 0) 00000100:00100000:3.0:1782727794.415796:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347639296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727794.415802:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1782727794.418073:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347639296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727794.418104:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff91fcc567bc00/0xb393e873fab644a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab644ac expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727794.418117:0:5948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff91fcc567bc00/0xb393e873fab644a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb393e873fab644ac expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727794.418210:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347639424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727794.418284:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727794.418335:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcfe4676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727794.418575:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347639424 00000100:00100000:3.0:1782727794.418582:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347639424 00000100:00100000:3.0:1782727794.418905:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782727794.418914:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347639424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727794.419049:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347639424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727794.419056:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1782727794.419092:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347639424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.419130:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347639552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727794.419169:0:5948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727794.421877:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347639552 00000100:00100000:0.0:1782727794.421902:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347639552 00000100:00100000:0.0:1782727794.421955:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1782727794.421966:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347639552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727794.422121:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:5948:x1869325347639552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727794.422128:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1782727794.422831:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fce0618480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727794.422860:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:5948:1869325347639552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782727794.425583:0:11916:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782727794.427870:0:5948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782727794.427985:0:5948:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727794.427998:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff91fcc567bc00/0xb393e873fab644a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab644ac expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727794.428011:0:5948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff91fcc567bc00/0xb393e873fab644a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb393e873fab644ac expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727794.780814:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727795.166629:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727795.166653:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347639680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727795.166740:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727795.166952:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347639680 00000100:00100000:3.0:1782727795.166963:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347639680 00000100:00100000:3.0:1782727795.167033:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727795.167043:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347639680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727795.167078:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727795.167129:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347639680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727795.167137:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1782727795.167181:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4d8e00 x1869325347639680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727795.167198:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347639680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782727795.808743:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727795.914124:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727795.914172:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727795.914481:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329771904 00000100:00100000:3.0:1782727795.914490:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329771904 00000100:00100000:3.0:1782727795.914565:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 96 00000100:00100000:3.0:1782727795.914577:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329771904:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727795.914652:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329771904:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 78us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727795.914659:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 96 00000100:00080000:3.0:1782727795.916539:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727795.916706:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329771776 00000100:00100000:0.0:1782727795.916719:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329771776 00000100:00100000:0.0:1782727795.916778:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 235 00000100:00100000:0.0:1782727795.916787:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329771776:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727795.916898:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329771776:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 110us (2782us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727795.916907:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 235 00000001:02000400:1.0:1782727796.271487:0:12055:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782727796.828961:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727797.853460:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727798.880512:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727799.259714:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347639808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727799.259792:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727799.259945:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347639808 00000100:00100000:1.0:1782727799.259955:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347639808 00000100:00100000:1.0:1782727799.260045:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782727799.260055:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347639808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727799.260087:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727799.260140:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347639808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727799.260147:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1782727799.260189:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4d5c00 x1869325347639808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727799.260211:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347639808:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782727799.260476:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727799.260735:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347640192:0@lo:400:kworker.0 00000100:00100000:3.0:1782727799.260772:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727799.260797:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727799.260814:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347640320:0@lo:400:kworker.0 00000100:00100000:3.0:1782727799.260840:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727799.260887:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347640192 00000100:00100000:3.0:1782727799.260892:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347640192 00000100:00100000:3.0:1782727799.260941:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782727799.260949:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347640192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727799.260994:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347640192:12345-0@lo:400:kworker.0 Request processed in 46us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727799.261000:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782727799.261021:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347640320 00000100:00100000:3.0:1782727799.261024:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347640320 00000100:00100000:3.0:1782727799.261069:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782727799.261076:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347640320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727799.261106:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347640320:12345-0@lo:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727799.261113:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1782727799.261134:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727799.261139:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782727799.261163:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4d9880 x1869325347640320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727799.261175:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347640320:0@lo:400:kworker.0 00000100:00100000:3.0:1782727799.261187:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347640192:0@lo:400:kworker.0 00000100:00100000:1.0:1782727799.262191:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347639936:0@lo:400:kworker.0 00000100:00100000:1.0:1782727799.262260:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727799.262319:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347640448:0@lo:400:kworker.0 00000100:00100000:1.0:1782727799.262349:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727799.262380:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727799.262387:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347640064:0@lo:400:kworker.0 00000100:00100000:1.0:1782727799.262409:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727799.262484:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347640448 00000100:00100000:1.0:1782727799.262491:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347640448 00000100:00100000:0.0:1782727799.262633:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347640064 00000100:00100000:0.0:1782727799.262638:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347640064 00000100:00100000:0.0:1782727799.262673:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782727799.262682:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347640064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727799.262737:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347640064:12345-0@lo:400:kworker.0 Request processed in 56us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727799.262744:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1782727799.262778:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727799.262823:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347640064:0@lo:400:kworker.0 00000100:00100000:1.0:1782727799.263321:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782727799.263331:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347640448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727799.263379:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347640448:12345-0@lo:400:kworker.0 Request processed in 51us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727799.263386:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782727799.263885:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347640448:0@lo:400:kworker.0 00000100:00100000:3.0:1782727799.264003:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347639936 00000100:00100000:3.0:1782727799.264011:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347639936 00000100:00100000:3.0:1782727799.264058:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1782727799.264065:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd0af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347639936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727799.264188:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd0af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347639936:12345-0@lo:400:kworker.0 Request processed in 122us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727799.264194:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1782727799.268708:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347639936:0@lo:400:kworker.0 00010000:00010000:2.0:1782727799.904815:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727800.284478:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347640576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727800.284557:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727800.284731:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347640576 00000100:00100000:1.0:1782727800.284740:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347640576 00000100:00100000:1.0:1782727800.284834:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782727800.284864:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347640576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727800.284906:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727800.284972:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347640576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727800.284980:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1782727800.285142:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4da300 x1869325347640576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727800.285165:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347640576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782727800.923802:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727801.025489:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727801.025559:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329772032 00000100:00100000:1.0:1782727801.025573:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329772032 00000100:00100000:0.0:1782727801.025582:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727801.025650:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 237 00000100:00100000:1.0:1782727801.025665:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329772032:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727801.025764:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329772032:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727801.025782:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 237 00000100:00100000:2.0:1782727801.025886:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329772160 00000100:00100000:2.0:1782727801.025891:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329772160 00000100:00100000:2.0:1782727801.026075:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 100 00000100:00100000:2.0:1782727801.026084:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329772160:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727801.026124:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329772160:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 41us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727801.026131:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 100 00000100:00080000:1.0:1782727801.036114:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1782727801.384356:0:12204:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 06:09:59 (1782727799) === 00000100:00100000:0.0:1782727801.492661:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727801.496479:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329772288 00000100:00100000:1.0:1782727801.496502:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329772288 00000100:00100000:1.0:1782727801.496596:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:1.0:1782727801.496606:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:7459:x1869325329772288:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1782727801.496633:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727801.496708:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab644b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bb9 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.496795:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab644ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.496810:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab644ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.496824:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab644ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.496871:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab644c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.496879:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab644c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.496886:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab644c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.496966:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab644ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.496974:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab644ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.496981:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab644ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.496987:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567ae00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727801.496992:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab644ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497000:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab644ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497013:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:1.0:1782727801.497016:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727801.497021:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab644ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497027:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab644ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497307:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab644c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497313:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab644c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497319:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab644c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497324:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567aa00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727801.497327:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab644c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497332:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab644c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497340:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff91fce0ba7f00) 00010000:00010000:1.0:1782727801.497342:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727801.497345:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab644c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497351:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab644c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497389:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab644b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bb9 expref: 7 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497399:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:1.0:1782727801.497401:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782727801.497414:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab644b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bb9 expref: 7 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.497456:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567a200, rc 0) 00000100:00100000:1.0:1782727801.497550:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:7459:x1869325329772288:12345-192.168.201.8@tcp:101:bash.0 Request processed in 944us (4900us total) trans 0 rc 301/301 00000100:00100000:1.0:1782727801.497559:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:0.0:1782727801.504878:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727801.505073:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329772416 00000100:00100000:1.0:1782727801.505088:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329772416 00000100:00100000:1.0:1782727801.505162:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:1.0:1782727801.505174:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:7459:x1869325329772416:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1782727801.505198:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727801.505223:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b400/0xb393e873fab644c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bc0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505308:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505325:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505339:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505353:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505361:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505367:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505447:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505457:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505463:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505470:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567b600 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727801.505475:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505482:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505498:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:1.0:1782727801.505502:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727801.505507:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505513:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505526:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505533:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505539:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505551:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567a800 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727801.505554:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505561:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505572:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff91fce0ba7a00) 00010000:00010000:1.0:1782727801.505575:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727801.505578:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505583:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505620:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b400/0xb393e873fab644c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bc0 expref: 7 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505630:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:1.0:1782727801.505632:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782727801.505636:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b400/0xb393e873fab644c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bc0 expref: 7 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.505644:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567b400, rc 0) 00000100:00100000:1.0:1782727801.505725:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:7459:x1869325329772416:12345-192.168.201.8@tcp:101:bash.0 Request processed in 552us (861us total) trans 0 rc 301/301 00000100:00100000:1.0:1782727801.505733:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:0.0:1782727801.514857:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727801.515263:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329772544 00000100:00100000:3.0:1782727801.515274:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329772544 00000100:00100000:3.0:1782727801.515340:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:3.0:1782727801.515351:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:7459:x1869325329772544:12345-192.168.201.8@tcp:37:bash.0 00000100:00100000:2.0:1782727801.522886:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:7459:x1869325329772544:12345-192.168.201.8@tcp:37:bash.0 Request processed in 7517us (8021us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727801.522914:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:0.0:1782727801.534806:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727801.537503:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329772672 00000100:00100000:3.0:1782727801.537519:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329772672 00000100:00100000:3.0:1782727801.537663:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:3.0:1782727801.537674:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10340:x1869325329772672:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:3.0:1782727801.537701:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727801.537725:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab644dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bc7 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.537807:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab644e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.537822:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab644e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538119:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab644e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538209:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab644eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538218:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab644eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538225:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab644eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538289:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab644e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538298:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab644e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538305:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab644e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538312:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346de00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727801.538327:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab644e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538336:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab644e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538350:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:3.0:1782727801.538354:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727801.538359:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab644e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538366:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab644e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538377:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab644eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538384:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab644eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538391:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab644eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538398:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346c800 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727801.538401:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab644eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538406:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab644eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538413:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff91fcd0ad3a00) 00010000:00010000:3.0:1782727801.538415:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727801.538447:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab644eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538455:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab644eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538717:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab644dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bc7 expref: 7 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538729:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:3.0:1782727801.538732:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727801.538737:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab644dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bc7 expref: 7 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.538747:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346ce00, rc 0) 00000100:00100000:3.0:1782727801.538825:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10340:x1869325329772672:12345-192.168.201.8@tcp:101:rm.0 Request processed in 1151us (4028us total) trans 0 rc 301/301 00000100:00100000:3.0:1782727801.538906:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:0.0:1782727801.722262:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727801.722330:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727801.722487:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329772800 00000100:00100000:3.0:1782727801.722500:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329772800 00000100:00100000:3.0:1782727801.722583:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:3.0:1782727801.722596:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329772800:12345-192.168.201.8@tcp:41:mkdir.0 00000004:00000024:3.0:1782727801.722645:0:5953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:3.0:1782727801.722850:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329772800:12345-192.168.201.8@tcp:41:mkdir.0 Request processed in 256us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727801.722858:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:2.0:1782727801.725784:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329772928 00000100:00100000:2.0:1782727801.725799:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329772928 00000100:00100000:2.0:1782727801.725870:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:2.0:1782727801.725881:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10347:x1869325329772928:12345-192.168.201.8@tcp:700:mkdir.0 00000100:00100000:2.0:1782727801.726247:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10347:x1869325329772928:12345-192.168.201.8@tcp:700:mkdir.0 Request processed in 365us (3914us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727801.726256:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:0.0:1782727801.739990:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727801.740245:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329773184 00000100:00100000:1.0:1782727801.740280:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329773184 00000100:00100000:1.0:1782727801.740374:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:1.0:1782727801.740388:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10347:x1869325329773184:12345-192.168.201.8@tcp:36:mkdir.0 00010000:00010000:1.0:1782727801.740526:0:5952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727801.740569:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab643c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488b96 expref: 6 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.740600:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:1.0:1782727801.740614:0:5952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727801.740706:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.740724:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.740735:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.740748:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.740755:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.740772:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727801.741671:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1782727801.741689:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.741697:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.741712:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.741718:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567a800 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727801.741722:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.741731:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.741743:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fce0ba7a00) 00010000:00010000:1.0:1782727801.741745:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727801.741748:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.741754:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab644f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727801.741782:0:5952:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a5842ed reply state 00000000dd901b68 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727801.741792:0:5952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782727801.741897:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:10347:x1869325329773184:12345-192.168.201.8@tcp:36:mkdir.0 Request processed in 1510us (1925us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782727801.741906:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00010000:00010000:3.0:1782727801.743696:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.743724:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.743731:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.743736:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567b600 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727801.743741:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.743748:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.743776:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91fce0ba7f00) 00010000:00010000:3.0:1782727801.743779:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727801.743784:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.743790:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab644f9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727801.752166:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727801.752508:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329773312 00000100:00100000:3.0:1782727801.752519:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329773312 00000100:00100000:3.0:1782727801.752594:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:3.0:1782727801.752606:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10348:x1869325329773312:12345-192.168.201.8@tcp:101:chmod.0 00010000:00010000:3.0:1782727801.752633:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727801.752658:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab64500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bce expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.752774:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64507 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.752789:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.752801:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727801.752864:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727801.752868:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727801.752901:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.752932:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab64500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bce expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.752954:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bce expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.752963:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3a00) 00010000:00010000:3.0:1782727801.752966:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727801.752970:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346c800, rc 0) 00000100:00100000:3.0:1782727801.753044:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:10348:x1869325329773312:12345-192.168.201.8@tcp:101:chmod.0 Request processed in 440us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727801.753051:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:1.0:1782727801.759485:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727801.760616:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329773568 00000100:00100000:3.0:1782727801.760637:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329773568 00000100:00100000:3.0:1782727801.760753:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:3.0:1782727801.760783:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:10348:x1869325329773568:12345-192.168.201.8@tcp:36:chmod.0 00010000:00010000:3.0:1782727801.760865:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727801.760904:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64507 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bce expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.760931:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3a00) 00010000:00010000:3.0:1782727801.760947:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727801.760977:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.761002:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.761014:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727801.761399:0:8231:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004775348c reply state 0000000035a3a0bb transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727801.761411:0:8231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782727801.761480:0:8231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1782727801.761600:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:10348:x1869325329773568:12345-192.168.201.8@tcp:36:chmod.0 Request processed in 835us (2128us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782727801.761608:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 16 00010000:00010000:0.0:1782727801.763616:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.763647:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.763654:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.763660:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346ce00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:0.0:1782727801.763681:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.763689:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.763707:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3700) 00010000:00010000:0.0:1782727801.763710:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782727801.763714:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.763720:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab6450e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727801.813267:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727801.817091:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329773696 00000100:00100000:2.0:1782727801.817108:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329773696 00000100:00100000:2.0:1782727801.817200:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:2.0:1782727801.817211:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:10349:x1869325329773696:12345-192.168.201.8@tcp:101:chown.0 00010000:00010000:2.0:1782727801.817239:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727801.817270:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab64515 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bd5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.817377:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6451c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.817393:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6451c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.817407:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6451c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727801.817488:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727801.817493:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727801.817528:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6451c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.817555:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab64515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bd5 expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.817575:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6451c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bd5 expref: 8 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.817584:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc2d08600) 00010000:00010000:2.0:1782727801.817587:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727801.817590:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77400, rc 0) 00000100:00100000:2.0:1782727801.817666:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:10349:x1869325329773696:12345-192.168.201.8@tcp:101:chown.0 Request processed in 456us (4418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727801.817673:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:2.0:1782727801.825708:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727801.825805:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329773824 00000100:00100000:1.0:1782727801.825816:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329773824 00000100:00100000:1.0:1782727801.825893:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:1.0:1782727801.825920:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:10349:x1869325329773824:12345-192.168.201.8@tcp:101:chown.0 00010000:00010000:1.0:1782727801.825943:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727801.825965:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab64523 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bdc expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826055:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6452a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826071:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6452a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826082:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6452a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826357:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab64531 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826365:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab64531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826373:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab64531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826492:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826500:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826508:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727801.826568:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727801.826572:0:5952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727801.826597:0:5952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826610:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6452a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826616:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6452a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826623:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6452a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826629:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567ae00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727801.826633:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6452a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826641:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6452a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826654:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc2d08600) 00010000:00010000:1.0:1782727801.826657:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727801.826662:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6452a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826668:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6452a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826679:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab64531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826695:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab64531 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826700:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab64531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826705:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567a200 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727801.826708:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab64531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826714:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab64531 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826722:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91fce0ba7a00) 00010000:00010000:1.0:1782727801.826724:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727801.826727:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab64531 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826732:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab64531 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826779:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab64523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bdc expref: 10 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826792:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bdc expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727801.826798:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fce0ba7800) 00010000:00010000:1.0:1782727801.826801:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727801.826809:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567a800, rc 0) 00000100:00100000:1.0:1782727801.826945:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:10349:x1869325329773824:12345-192.168.201.8@tcp:101:chown.0 Request processed in 1027us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727801.826955:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:1.0:1782727801.844013:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727801.844716:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329774080 00000100:00100000:3.0:1782727801.844731:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329774080 00000100:00100000:3.0:1782727801.844823:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:3.0:1782727801.844833:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:10349:x1869325329774080:12345-192.168.201.8@tcp:36:chown.0 00010000:00010000:3.0:1782727801.844931:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727801.844965:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bdc expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.844985:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fce0ba7800) 00010000:00010000:3.0:1782727801.844995:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727801.845221:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.845248:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.845261:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782727801.848772:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1782727801.849053:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c652c53 reply state 000000007c1e99c2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727801.849085:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782727801.849102:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1782727801.849257:0:5953:0:(ldlm_lib.c:3443:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782727801.849287:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:10349:x1869325329774080:12345-192.168.201.8@tcp:36:chown.0 Request processed in 4446us (5283us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782727801.849299:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00010000:00010000:3.0:1782727801.849649:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.849663:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.849672:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.849681:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346c800 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727801.849688:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.849698:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.849743:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fcd0ad3a00) 00010000:00010000:3.0:1782727801.849746:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782727801.849754:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.849771:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6453f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727801.887155:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727801.887394:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329774208 00000100:00100000:3.0:1782727801.887406:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329774208 00000100:00100000:3.0:1782727801.887564:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:3.0:1782727801.887576:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10350:x1869325329774208:12345-192.168.201.8@tcp:101:touch.500 00010000:00010000:3.0:1782727801.887611:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727801.887631:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64546 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488be3 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782727801.890867:0:8231:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3168us 00010000:00010000:0.0:1782727801.946653:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6454d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.946681:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6454d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.946707:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6454d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.946725:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab64554 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.946752:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab64554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.946768:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab64554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.946898:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab6455b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.946906:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab6455b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.946913:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab6455b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727801.946949:0:8231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727801.946953:0:8231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727801.946989:0:8231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab6455b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947008:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6454d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947015:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6454d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947021:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6454d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947027:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc147fc00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:0.0:1782727801.947032:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6454d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947047:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6454d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947060:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc2d08600) 00010000:00010000:0.0:1782727801.947063:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727801.947067:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6454d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947073:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6454d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947088:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab64554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947095:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab64554 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947106:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab64554 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947112:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc147ec00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:0.0:1782727801.947115:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab64554 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947121:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab64554 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947127:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91fcfde64f00) 00010000:00010000:0.0:1782727801.947129:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727801.947132:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab64554 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947147:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab64554 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947196:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488be3 expref: 8 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947214:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab6455b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488be3 expref: 7 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.947222:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:0.0:1782727801.947224:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782727801.947226:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147e600, rc 0) 00000100:00100000:0.0:1782727801.947308:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:10350:x1869325329774208:12345-192.168.201.8@tcp:101:touch.500 Request processed in 59734us (60165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727801.947317:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00010000:00010000:2.0:1782727801.948971:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727801.956845:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727801.957731:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329774464 00000100:00100000:2.0:1782727801.957745:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329774464 00000100:00100000:2.0:1782727801.957836:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:2.0:1782727801.957847:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:10350:x1869325329774464:12345-192.168.201.8@tcp:101:touch.500 00010000:00010000:2.0:1782727801.957871:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727801.957897:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab64562 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958058:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64569 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958078:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64569 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958092:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64569 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958154:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958162:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958190:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782727801.958740:0:5951:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1782727801.958917:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab64577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958929:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab64577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958938:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab64577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958979:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64569 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958986:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64569 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958993:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64569 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.958999:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a77a00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727801.959004:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64569 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.959011:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64569 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.959023:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:2.0:1782727801.959026:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727801.959037:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64569 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.959045:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64569 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727801.959062:0:5951:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ae913c2 reply state 0000000006a4b38b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727801.959073:0:5951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782727801.959116:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab64562 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bea expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.959132:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab64577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bea expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727801.959138:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91fcc2d08f00) 00010000:00010000:2.0:1782727801.959140:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727801.959142:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77c00, rc 0) 00000100:00100000:2.0:1782727801.959222:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:10350:x1869325329774464:12345-192.168.201.8@tcp:101:touch.500 Request processed in 1376us (2389us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1782727801.959231:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 21 00010000:00010000:0.0:1782727801.970861:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.970880:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.970888:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.970894:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a77e00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:0.0:1782727801.970899:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.970907:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.970947:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe8bf51a6 (ffff91fcc2d08d00) 00010000:00010000:0.0:1782727801.970951:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727801.970956:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.970964:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64570 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727801.974915:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727801.975165:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329774720 00000100:00100000:3.0:1782727801.975177:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329774720 00000100:00100000:3.0:1782727801.975268:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:3.0:1782727801.975279:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:10350:x1869325329774720:12345-192.168.201.8@tcp:36:touch.500 00010000:00010000:3.0:1782727801.975341:0:5952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727801.975368:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab64577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bea expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.975390:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91fcc2d08f00) 00010000:00010000:3.0:1782727801.975402:0:5952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727801.975659:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.975689:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.975700:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727801.975862:0:5952:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079f22160 reply state 0000000081f02067 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727801.975873:0:5952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782727801.975986:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:10350:x1869325329774720:12345-192.168.201.8@tcp:36:touch.500 Request processed in 707us (1079us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782727801.975996:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:2.0:1782727801.989033:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727801.989157:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329774848 00000100:00100000:0.0:1782727801.989174:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329774848 00000100:00100000:0.0:1782727801.989262:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:0.0:1782727801.989275:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:10350:x1869325329774848:12345-192.168.201.8@tcp:101:touch.500 00010000:00010000:0.0:1782727801.989311:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727801.989338:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab6458c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bf1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.989475:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab6458c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bf1 expref: 11 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.989494:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab6458c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bf1 expref: 11 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727801.989517:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91fcf9f5bf00) 00010000:00010000:0.0:1782727801.989520:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782727801.989526:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147ec00, rc 0) 00000100:00100000:0.0:1782727801.989604:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+11:10350:x1869325329774848:12345-192.168.201.8@tcp:101:touch.500 Request processed in 331us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727801.989630:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 23 00010000:00010000:3.0:1782727801.990478:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.990503:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.990510:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.990516:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346de00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727801.990521:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.990528:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.990542:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91fcf9f5bf00) 00010000:00010000:3.0:1782727801.990553:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727801.990557:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727801.990564:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64585 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727802.005928:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727802.006032:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329774976 00000100:00100000:2.0:1782727802.006042:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329774976 00000100:00100000:2.0:1782727802.006094:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:2.0:1782727802.006103:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1869325329774976:12345-192.168.201.8@tcp:8:touch.500 00010000:00080000:2.0:1782727802.006146:0:6940:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from 7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:2.0:1782727802.006178:0:6940:0:(genops.c:1406:class_connect()) connect: client 7bd37c29-d4cd-43a2-9946-117a0c108d30, cookie 0xb393e873fab64593 00002000:00100000:2.0:1782727802.006209:0:6940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7bd37c29-d4cd-43a2-9946-117a0c108d30/ffff91fcfe2e4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782727802.006232:0:6940:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782727802.006337:0:6940:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782727802.006365:0:6940:0:(import.c:65:import_set_state_nolock()) ffff91fcfe2e5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727802.006468:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2349:x1869325329774976:12345-192.168.201.8@tcp:8:touch.500 Request processed in 365us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727802.006476:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:1.0:1782727802.021596:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727802.021911:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329775104 00000100:00100000:3.0:1782727802.021921:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329775104 00000100:00100000:3.0:1782727802.021992:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:3.0:1782727802.022001:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:0:x1869325329775104:12345-192.168.201.8@tcp:2:touch.500 00000100:00080000:1.0:1782727802.022247:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1782727802.030793:0:8008:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1782727802.030814:0:8008:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bd37c29-d4cd-43a2-9946-117a0c108d30 00000100:00100000:2.0:1782727802.033987:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:0:x1869325329775104:12345-192.168.201.8@tcp:2:touch.500 Request processed in 11974us (12401us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782727802.034000:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:0.0:1782727802.058005:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727802.058654:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329775360 00000100:00100000:1.0:1782727802.058667:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329775360 00000100:00100000:1.0:1782727802.058882:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:1.0:1782727802.058897:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:10350:x1869325329775360:12345-192.168.201.8@tcp:35:touch.500 00000100:00100000:1.0:1782727802.059318:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+11:10350:x1869325329775360:12345-192.168.201.8@tcp:35:touch.500 Request processed in 423us (1323us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1782727802.059327:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:1.0:1782727802.087071:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727802.087401:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329775488 00000100:00100000:2.0:1782727802.087416:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329775488 00000100:00100000:2.0:1782727802.087512:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:2.0:1782727802.087523:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+11:10351:x1869325329775488:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:2.0:1782727802.087553:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727802.087575:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6459a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bf8 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.087878:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab645a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.087895:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab645a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.087908:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab645a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727802.087971:0:8231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727802.087990:0:8231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727802.088036:0:8231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab645a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.088070:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6459a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bf8 expref: 13 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.088092:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab645a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bf8 expref: 12 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.088101:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:2.0:1782727802.088105:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727802.088108:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77a00, rc 0) 00000100:00100000:2.0:1782727802.088210:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+12:10351:x1869325329775488:12345-192.168.201.8@tcp:101:rm.0 Request processed in 688us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727802.088219:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:3.0:1782727802.093167:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727802.093297:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329775744 00000100:00100000:0.0:1782727802.093308:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329775744 00000100:00100000:0.0:1782727802.093375:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00100000:0.0:1782727802.093387:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+12:10351:x1869325329775744:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:0.0:1782727802.093408:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727802.093469:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab645a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488bff expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727802.093573:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782727802.093921:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab645a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bff expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727802.093936:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc2d08600) 00010000:00010000:0.0:1782727802.093940:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782727802.093944:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab645a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bff expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727802.093960:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147e200, rc 0) 00000100:00100000:0.0:1782727802.094974:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+13:10351:x1869325329775744:12345-192.168.201.8@tcp:101:rm.0 Request processed in 1584us (1812us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1782727802.094985:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00100000:3.0:1782727802.105074:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727802.105232:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329775872 00000100:00100000:2.0:1782727802.105248:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329775872 00000100:00100000:2.0:1782727802.105326:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:2.0:1782727802.105339:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+13:10351:x1869325329775872:12345-192.168.201.8@tcp:37:rm.0 00000100:00100000:3.0:1782727802.110511:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+13:10351:x1869325329775872:12345-192.168.201.8@tcp:37:rm.0 Request processed in 5155us (5435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727802.110534:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:1.0:1782727802.114790:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727802.115051:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329776128 00000100:00100000:0.0:1782727802.115076:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329776128 00000100:00100000:0.0:1782727802.115171:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:0.0:1782727802.115182:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fced2c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+13:10351:x1869325329776128:12345-192.168.201.8@tcp:35:rm.0 00000100:00100000:0.0:1782727802.115415:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fced2c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+14:10351:x1869325329776128:12345-192.168.201.8@tcp:35:rm.0 Request processed in 234us (643us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782727802.115458:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:1.0:1782727802.120415:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727802.120810:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329776384 00000100:00100000:3.0:1782727802.120821:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329776384 00000100:00100000:3.0:1782727802.120919:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:3.0:1782727802.120929:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+14:10351:x1869325329776384:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:3.0:1782727802.120954:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727802.120976:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c06 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.121117:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab645bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.121150:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab645bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.121175:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab645bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727802.121599:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782727802.121735:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c06 expref: 17 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.121764:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab645bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c06 expref: 16 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.121774:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:3.0:1782727802.121777:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782727802.121780:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346c800, rc 0) 00000100:00100000:3.0:1782727802.121887:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:10351:x1869325329776384:12345-192.168.201.8@tcp:101:rm.0 Request processed in 958us (1484us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782727802.121894:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:2.0:1782727802.125417:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727802.125657:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329776512 00000100:00100000:3.0:1782727802.125666:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329776512 00000100:00100000:3.0:1782727802.125722:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:3.0:1782727802.125734:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:10351:x1869325329776512:12345-192.168.201.8@tcp:41:rm.0 00000004:00000024:3.0:1782727802.125794:0:5951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847337984 avail 7384293376 00000100:00100000:3.0:1782727802.125868:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:10351:x1869325329776512:12345-192.168.201.8@tcp:41:rm.0 Request processed in 137us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727802.125875:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:1.0:1782727802.128602:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727802.128699:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329776640 00000100:00100000:2.0:1782727802.128709:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329776640 00000100:00100000:2.0:1782727802.128773:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:2.0:1782727802.128784:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:10351:x1869325329776640:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:2.0:1782727802.128804:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727802.128826:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab645cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c0d expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.128922:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab645d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.128938:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab645d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.128949:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab645d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.128963:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab645d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.128971:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab645d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.128977:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab645d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129068:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab645e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129076:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab645e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129082:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab645e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727802.129119:0:8231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782727802.129123:0:8231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727802.129141:0:8231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab645e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129165:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab645e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129174:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab645d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129180:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab645d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129187:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab645d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129192:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76400 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727802.129196:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab645d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129204:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab645d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129214:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:2.0:1782727802.129217:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727802.129222:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab645d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129228:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab645d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129255:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab645d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129262:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab645d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129272:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab645d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129277:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76a00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727802.129280:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab645d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129285:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab645d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129292:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe8bf51a6 (ffff91fcc2d08200) 00010000:00010000:2.0:1782727802.129294:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727802.129297:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab645d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129302:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab645d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129332:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab645cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c0d expref: 18 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129346:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab645e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c0d expref: 17 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.129353:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91fcf9f5bf00) 00010000:00010000:2.0:1782727802.129355:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727802.129358:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a76800, rc 0) 00000100:00100000:2.0:1782727802.129468:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+17:10351:x1869325329776640:12345-192.168.201.8@tcp:101:rm.0 Request processed in 641us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727802.129486:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:2.0:1782727802.133488:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727802.133616:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329776896 00000100:00100000:3.0:1782727802.133626:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329776896 00000100:00100000:3.0:1782727802.133702:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:3.0:1782727802.133712:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+17:10351:x1869325329776896:12345-192.168.201.8@tcp:36:rm.0 00010000:00010000:3.0:1782727802.133778:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782727802.133804:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab645e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c0d expref: 17 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.133828:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab6458c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bf1 expref: 16 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.133840:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91fcf9f5bf00) 00010000:00010000:3.0:1782727802.133854:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab645a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bf8 expref: 15 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.133863:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:3.0:1782727802.133866:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727802.133885:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.133900:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.133909:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.133922:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.133929:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.133946:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134090:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab645f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134098:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab645f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134105:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab645f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782727802.134323:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1782727802.134332:0:5951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 309018908076ns, next at 310018906341ns, rc = 0 00010000:00010000:3.0:1782727802.134377:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134386:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134394:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134402:0:5951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134409:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134415:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134479:0:5951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782727802.134504:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab645f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134511:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab645f5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134517:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab645f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134523:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346dc00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727802.134527:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab645f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134534:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab645f5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134543:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91fcf9f5b700) 00010000:00010000:3.0:1782727802.134545:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782727802.134549:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab645f5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134555:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab645f5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134569:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134574:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134580:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134590:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346de00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727802.134594:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134599:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134607:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:3.0:1782727802.134609:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727802.134612:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.134617:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab645e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727802.134625:0:5951:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000abe203a7 reply state 0000000040ea49a2 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727802.134634:0:5951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782727802.134701:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:10351:x1869325329776896:12345-192.168.201.8@tcp:36:rm.0 Request processed in 989us (1233us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1782727802.134709:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 29 00010000:00010000:2.0:1782727802.135147:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727802.135154:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.135161:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346cc00 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:2.0:1782727802.135164:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.135172:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.135181:0:5940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91fcf9f5b700) 00010000:00010000:2.0:1782727802.135184:0:5940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782727802.135187:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.135193:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab645fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.135206:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727802.135208:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727802.135210:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727802.138319:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.138335:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.138343:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.138365:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346ce00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727802.138371:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.138379:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.138395:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe8bf51a6 (ffff91fcf9f5bb00) 00010000:00010000:2.0:1782727802.138398:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727802.138402:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.138409:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab645ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe8bf51a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727802.139558:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727802.139818:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329777152 00000100:00100000:3.0:1782727802.139828:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329777152 00000100:00100000:3.0:1782727802.139884:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:3.0:1782727802.139893:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+15:10351:x1869325329777152:12345-192.168.201.8@tcp:35:rm.0 00000100:00100000:3.0:1782727802.140140:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:10351:x1869325329777152:12345-192.168.201.8@tcp:35:rm.0 Request processed in 247us (592us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782727802.140162:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:1.0:1782727802.142534:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727802.142633:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329777408 00000100:00100000:2.0:1782727802.142642:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329777408 00000100:00100000:2.0:1782727802.142690:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00100000:2.0:1782727802.142699:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:10351:x1869325329777408:12345-192.168.201.8@tcp:36:rm.0 00010000:00010000:2.0:1782727802.142750:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782727802.142786:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab645bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c06 expref: 16 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.142810:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab6455b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488be3 expref: 15 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.142821:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fcfde64600) 00010000:00010000:2.0:1782727802.142853:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6451c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488bd5 expref: 14 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.142862:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc2d08600) 00010000:00010000:2.0:1782727802.142868:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727802.142890:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64603 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.142903:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64603 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.142913:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64603 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.142926:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.142933:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.142940:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143019:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64611 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143027:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64611 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143033:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64611 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727802.143244:0:8231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782727802.143265:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64611 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143272:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64611 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143279:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64611 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143285:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76400 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727802.143289:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64611 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143296:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64611 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143305:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91fcc2d08700) 00010000:00010000:2.0:1782727802.143308:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782727802.143311:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64611 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143317:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64611 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143335:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64603 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143342:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64603 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143347:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64603 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143353:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76000 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727802.143362:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64603 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143369:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64603 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143378:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc2d08200) 00010000:00010000:2.0:1782727802.143380:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727802.143383:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64603 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.143389:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64603 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727802.143401:0:8231:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002eabf8f7 reply state 000000004ee5fb34 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727802.143410:0:8231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727802.143508:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+15:10351:x1869325329777408:12345-192.168.201.8@tcp:36:rm.0 Request processed in 808us (981us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782727802.143517:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 30 00010000:00010000:3.0:1782727802.153371:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.153390:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.153397:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.153403:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76a00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727802.153408:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.153415:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.153468:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91fcc2d08a00) 00010000:00010000:3.0:1782727802.153472:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727802.153477:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727802.153492:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab6460a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727802.972353:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727803.995780:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782727804.379673:0:8369:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311264245487ns, next at 312264241463ns, rc = 0 00000100:00100000:0.0:1782727804.379941:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727804.379967:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347640704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727804.380049:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727804.380454:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347640704 00000100:00100000:2.0:1782727804.380462:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347640704 00000100:00100000:2.0:1782727804.380539:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782727804.380549:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347640704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727804.380583:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:1.0:1782727804.380732:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727804.380827:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347640704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 279us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727804.380835:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1782727804.381053:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4d7800 x1869325347640704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727804.381090:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347640704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727804.382386:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347641216:0@lo:400:kworker.0 00000100:00100000:2.0:1782727804.382488:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727804.382533:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782727804.382539:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347640832:0@lo:400:kworker.0 00000100:00100000:2.0:1782727804.382566:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727804.382885:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347641344:0@lo:400:kworker.0 00000100:00100000:2.0:1782727804.382916:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727804.383018:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347641216 00000100:00100000:2.0:1782727804.383025:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347641216 00000100:00100000:2.0:1782727804.383088:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782727804.383099:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfb28d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347641216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727804.383158:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfb28d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347641216:12345-0@lo:400:kworker.0 Request processed in 60us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727804.383374:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325347641088:0@lo:400:kworker.0 00000100:00100000:3.0:1782727804.383407:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727804.383452:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727804.383459:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347640960:0@lo:400:kworker.0 00000100:00100000:3.0:1782727804.383482:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727804.383529:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347641344 00000100:00100000:3.0:1782727804.383534:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347641344 00000100:00100000:3.0:1782727804.383565:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347641088 00000100:00100000:3.0:1782727804.383569:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347641088 00000100:00100000:3.0:1782727804.383581:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347640960 00000100:00100000:3.0:1782727804.383583:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347640960 00000100:00100000:3.0:1782727804.383608:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782727804.383614:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347641344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727804.383647:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347641344:12345-0@lo:400:kworker.0 Request processed in 33us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727804.383654:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782727804.383675:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782727804.383681:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325347641088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727804.383712:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325347641088:12345-0@lo:400:kworker.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727804.383731:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782727804.383744:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782727804.383750:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347640960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727804.383777:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347640960:12345-0@lo:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727804.383782:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782727804.383820:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347640960:0@lo:400:kworker.0 00000100:00100000:3.0:1782727804.383831:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325347641088:0@lo:400:kworker.0 00000100:00080000:3.0:1782727804.383901:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727804.383907:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727804.383917:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347640832 00000100:00100000:3.0:1782727804.383920:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347640832 00000100:00100000:3.0:1782727804.383972:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1782727804.383978:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347640832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727804.384012:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347640832:12345-0@lo:400:kworker.0 Request processed in 34us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727804.384019:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1782727804.384062:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347640832:0@lo:400:kworker.0 00000100:00100000:3.0:1782727804.384073:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347641344:0@lo:400:kworker.0 00010000:00080000:3.0:1782727804.384087:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe4dad80 x1869325347641216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727804.384098:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347641216:0@lo:400:kworker.0 00000100:00100000:2.0:1782727804.384705:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1782727805.023577:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727805.403741:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727805.403774:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347641472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727805.403861:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727805.404120:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347641472 00000100:00100000:2.0:1782727805.404130:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347641472 00000100:00100000:2.0:1782727805.404200:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782727805.404210:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347641472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727805.404250:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727805.404317:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347641472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727805.404324:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1782727805.404851:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcfe475180 x1869325347641472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727805.404874:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347641472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782727806.044242:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727806.162402:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727806.162469:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727806.162510:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727806.162576:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329777792 00000100:00100000:2.0:1782727806.162590:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329777792 00000100:00100000:2.0:1782727806.162668:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:0.0:1782727806.162671:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329777536 00000100:00100000:0.0:1782727806.162675:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329777536 00000100:00100000:2.0:1782727806.162702:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2352:x1869325329777792:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727806.162713:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 239 00000100:00100000:0.0:1782727806.162718:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2352:x1869325329777536:12345-192.168.201.8@tcp:400:kworker.0 00000100:00080000:1.0:1782727806.162786:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727806.162840:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329777664 00000100:00100000:3.0:1782727806.162844:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329777664 00000100:00100000:2.0:1782727806.162849:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2352:x1869325329777792:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 160us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727806.162866:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:3.0:1782727806.162879:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 104 00000100:00100000:3.0:1782727806.162886:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+14:2353:x1869325329777664:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727806.165162:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2352:x1869325329777536:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 2425us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727806.165196:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 239 00000100:00080000:0.0:1782727806.165307:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727806.165670:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+14:2353:x1869325329777664:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 2781us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727806.165681:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 104 00010000:00010000:2.0:1782727807.072379:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782727807.987013:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1782727807.987054:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1782727807.987067:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1782727807.987383:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347641600:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782727807.987487:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727807.987598:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347641600 00000100:00100000:3.0:1782727807.987617:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347641600 00000100:00100000:3.0:1782727807.987687:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727807.987698:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347641600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782727807.987729:0:6939:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1782727807.987766:0:6939:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a42447a, atime: 0x6a42447a, ctime: 0x6a42447a, blocks: 0x0 00010000:00010000:3.0:1782727807.987775:0:6939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4c7ca70/0xb393e873fab64618 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727807.987808:0:6939:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=314s v=(0 0) 00010000:00010000:3.0:1782727807.987813:0:6939:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782727807.987822:0:6939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c7ca70/0xb393e873fab64618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727807.987842:0:6939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4c7ca70/0xb393e873fab64618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727807.987854:0:6939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4c7ca70/0xb393e873fab64618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727807.987862:0:6939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c7ca70/0xb393e873fab64618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727807.987883:0:6939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782727807.988095:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3445:x1869325347641600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 398us (607us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782727807.988103:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1782727807.988135:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727807.988344:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4c7ca70/0xb393e873fab64618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727807.988352:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346de00 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:3.0:1782727807.988356:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c7ca70/0xb393e873fab64618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727807.988364:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c7ca70/0xb393e873fab64618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727807.988381:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4c7ca70/0xb393e873fab64618 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727807.988389:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4c7ca70/0xb393e873fab64618 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727807.988410:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727807.988412:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727807.988413:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782727807.988497:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1782727807.988536:0:3445:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91fcfe4daa00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1782727807.988543:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347641600:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782727808.093047:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727808.878035:0:12254:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync ============================================================= 06:10:07 (1782727807) 00010000:00010000:0.0:1782727809.134328:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727809.503711:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347641984:0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.503818:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727809.503913:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727809.503919:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347642112:0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.503946:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727809.503992:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347641984 00000100:00100000:0.0:1782727809.504001:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347641984 00000100:00100000:0.0:1782727809.504062:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782727809.504071:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347641984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.504126:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347641984:12345-0@lo:400:kworker.0 Request processed in 56us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727809.504133:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782727809.504161:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347642112 00000100:00100000:0.0:1782727809.504165:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347642112 00000100:00100000:0.0:1782727809.504192:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782727809.504199:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347642112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.504228:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347642112:12345-0@lo:400:kworker.0 Request processed in 30us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727809.504234:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1782727809.504250:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727809.504257:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727809.504291:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91fcf7eeea00 x1869325347642112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727809.504308:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347642112:0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.504320:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347641984:0@lo:400:kworker.0 00000100:00100000:2.0:1782727809.504467:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347641856:0@lo:400:kworker.0 00000100:00100000:2.0:1782727809.504504:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727809.504528:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347642368:0@lo:400:kworker.0 00000100:00100000:2.0:1782727809.504549:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727809.504567:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782727809.504572:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347641728:0@lo:400:kworker.0 00000100:00100000:2.0:1782727809.504599:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727809.504619:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347642240:0@lo:400:kworker.0 00000100:00100000:2.0:1782727809.504649:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727809.504718:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347641856 00000100:00100000:0.0:1782727809.504721:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347641856 00000100:00100000:0.0:1782727809.504754:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347642240 00000100:00100000:0.0:1782727809.504757:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347642240 00000100:00100000:0.0:1782727809.504787:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782727809.504791:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347641856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.504823:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347641856:12345-0@lo:400:kworker.0 Request processed in 30us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727809.504828:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782727809.504838:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782727809.504842:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347642240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.504863:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347642240:12345-0@lo:400:kworker.0 Request processed in 21us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727809.504867:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782727809.504882:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347641728 00000100:00100000:0.0:1782727809.504885:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347641728 00000100:00100000:0.0:1782727809.504910:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1782727809.504916:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347641728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.504943:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347641728:12345-0@lo:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727809.504949:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:0.0:1782727809.504971:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727809.504985:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347641728:0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.504994:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347642240:0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.505002:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347641856:0@lo:400:kworker.0 00000100:00100000:0.0:1782727809.506016:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727809.506035:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347642496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727809.506079:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727809.506802:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347642368 00000100:00100000:3.0:1782727809.506812:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347642368 00000100:00100000:3.0:1782727809.506873:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782727809.506884:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3443:x1869325347642368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727809.506955:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3443:x1869325347642368:12345-0@lo:400:kworker.0 Request processed in 73us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727809.506964:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1782727809.506995:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727809.507035:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347642368:0@lo:400:kworker.0 00000100:00100000:2.0:1782727809.508099:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347642496 00000100:00100000:2.0:1782727809.508109:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347642496 00000100:00100000:2.0:1782727809.508154:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782727809.508163:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3445:x1869325347642496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727809.508197:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727809.508270:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3445:x1869325347642496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727809.508278:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782727809.508335:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347642496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727809.926775:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727809.930828:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329777920 00000100:00100000:2.0:1782727809.930846:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329777920 00000100:00100000:2.0:1782727809.930934:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:2.0:1782727809.930943:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:10927:x1869325329777920:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:2.0:1782727809.930963:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727809.930990:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab6461f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c14 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782727809.931038:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727809.931061:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64626 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.931072:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.931081:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727809.931123:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727809.931127:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727809.931166:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.931189:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab6461f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c14 expref: 7 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.931202:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c14 expref: 6 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.931209:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42100) 00010000:00010000:2.0:1782727809.931219:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727809.931224:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77e00, rc 0) 00000100:00100000:2.0:1782727809.931313:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10927:x1869325329777920:12345-192.168.201.8@tcp:101:dd.0 Request processed in 370us (4550us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727809.931320:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:2.0:1782727809.944227:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727809.944265:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329778176 00000100:00100000:2.0:1782727809.944275:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329778176 00000100:00100000:2.0:1782727809.944326:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:2.0:1782727809.944333:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10927:x1869325329778176:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:2.0:1782727809.944351:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727809.944353:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782727809.944375:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64626 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c14 expref: 6 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.944387:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42100) 00010000:00010000:2.0:1782727809.944394:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727809.944405:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab6462d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c1b expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.944512:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64634 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.944523:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64634 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.944530:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64634 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.944538:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.944549:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.944553:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782727809.944888:0:8231:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1782727809.945036:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64642 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945045:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945051:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945085:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64634 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945093:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64634 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945099:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64634 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945106:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76600 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727809.945110:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64634 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945118:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64634 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945138:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42b00) 00010000:00010000:2.0:1782727809.945141:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727809.945144:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64634 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945151:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64634 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727809.945162:0:8231:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000077928f6b reply state 00000000d436f5e6 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727809.945171:0:8231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782727809.945197:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab6462d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c1b expref: 8 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945213:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c1b expref: 7 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727809.945220:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91fcd3c42900) 00010000:00010000:2.0:1782727809.945222:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727809.945224:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77400, rc 0) 00000100:00100000:2.0:1782727809.945295:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:10927:x1869325329778176:12345-192.168.201.8@tcp:101:dd.0 Request processed in 961us (1078us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782727809.945302:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 32 00010000:00010000:3.0:1782727809.956909:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727809.956934:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727809.956942:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727809.956949:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76200 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727809.956954:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727809.956962:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727809.956984:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff91fcd3c42a00) 00010000:00010000:3.0:1782727809.956987:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727809.956992:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727809.956998:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76200/0xb393e873fab6463b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727809.963030:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727809.964008:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329778304 00000100:00100000:0.0:1782727809.964025:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329778304 00000100:00100000:0.0:1782727809.964078:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:0.0:1782727809.964086:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1869325329778304:12345-192.168.201.8@tcp:8:dd.0 00010000:00080000:0.0:1782727809.964122:0:6939:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from 7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:0.0:1782727809.964155:0:6939:0:(genops.c:1406:class_connect()) connect: client 7bd37c29-d4cd-43a2-9946-117a0c108d30, cookie 0xb393e873fab64650 00002000:00100000:0.0:1782727809.964168:0:6939:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7bd37c29-d4cd-43a2-9946-117a0c108d30/ffff91fcfe2be000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782727809.964186:0:6939:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782727809.964268:0:6939:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782727809.964294:0:6939:0:(import.c:65:import_set_state_nolock()) ffff91fcfe2bb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727809.964354:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2349:x1869325329778304:12345-192.168.201.8@tcp:8:dd.0 Request processed in 267us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727809.964362:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:1.0:1782727809.969511:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727809.971466:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329778432 00000100:00100000:0.0:1782727809.971487:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329778432 00000100:00100000:0.0:1782727809.971560:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:0.0:1782727809.971570:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10927:x1869325329778432:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:0.0:1782727809.971591:0:6940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727809.971621:0:6940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d23475a/0xb393e873fab64657 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c22 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782727809.971660:0:6940:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782727809.971685:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1782727809.971690:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782727809.971702:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d23475a/0xb393e873fab64657 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c22 expref: 7 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727809.971739:0:6940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d23475a/0xb393e873fab64657 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c22 expref: 7 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727809.971755:0:6940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147e200, rc 0) 00000100:00100000:0.0:1782727809.971835:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:10927:x1869325329778432:12345-192.168.201.8@tcp:101:dd.0 Request processed in 266us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727809.971843:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00080000:3.0:1782727809.973059:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727809.982851:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727809.983085:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329778688 00000100:00100000:1.0:1782727809.983097:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329778688 00000100:00100000:1.0:1782727809.983170:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:1.0:1782727809.983180:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:10927:x1869325329778688:12345-192.168.201.8@tcp:35:dd.0 00000001:00080000:1.0:1782727809.983499:0:5955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967310 00000100:00100000:1.0:1782727809.983641:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:10927:x1869325329778688:12345-192.168.201.8@tcp:35:dd.0 Request processed in 461us (802us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782727809.983649:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00000020:00080000:1.0:1782727809.983654:0:5955:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782727810.003395:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727810.003559:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329778816 00000100:00100000:0.0:1782727810.003574:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329778816 00000100:00100000:0.0:1782727810.003650:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:0.0:1782727810.003661:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:10928:x1869325329778816:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:0.0:1782727810.003690:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727810.003715:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6465e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c29 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.003795:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64665 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.003812:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.003827:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727810.003883:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727810.003897:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727810.003924:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.003950:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab6465e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c29 expref: 11 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.003973:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64665 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c29 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.003985:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde64b00) 00010000:00010000:0.0:1782727810.003989:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727810.003993:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147ea00, rc 0) 00000100:00100000:0.0:1782727810.004068:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:10928:x1869325329778816:12345-192.168.201.8@tcp:101:rm.0 Request processed in 409us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727810.004076:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:0.0:1782727810.024187:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727810.024338:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329779072 00000100:00100000:3.0:1782727810.024349:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329779072 00000100:00100000:3.0:1782727810.024419:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 34 00000100:00100000:3.0:1782727810.024471:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:10928:x1869325329779072:12345-192.168.201.8@tcp:36:rm.0 00010000:00010000:3.0:1782727810.024553:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782727810.024583:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64642 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c1b expref: 10 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.024602:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91fcd3c42900) 00010000:00010000:3.0:1782727810.024639:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64665 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c29 expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.024651:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde64b00) 00010000:00010000:3.0:1782727810.024659:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727810.024694:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6466c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.024709:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6466c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.024719:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6466c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.024733:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.024740:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.024747:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.024844:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6467a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.024866:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6467a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.024872:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6467a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782727810.025111:0:5953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1782727810.025121:0:5953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316909697396ns, next at 317909695594ns, rc = 0 00010000:00010000:3.0:1782727810.025166:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025175:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025181:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025188:0:5953:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025193:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025197:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025525:0:5953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782727810.025547:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6467a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025554:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6467a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025566:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6467a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025571:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346d200 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727810.025575:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6467a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025581:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6467a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025588:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91fcf9f5b000) 00010000:00010000:3.0:1782727810.025591:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782727810.025594:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6467a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025598:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6467a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025613:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6466c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025618:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6466c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025633:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6466c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025637:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346dc00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727810.025639:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6466c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025652:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6466c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025660:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcf9f5bf00) 00010000:00010000:3.0:1782727810.025663:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727810.025665:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6466c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.025671:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6466c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727810.025683:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007bef764b reply state 00000000a3f5b55b transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727810.025692:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782727810.025779:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:10928:x1869325329779072:12345-192.168.201.8@tcp:36:rm.0 Request processed in 1309us (1599us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1782727810.025789:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 34 00010000:00010000:0.0:1782727810.025893:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727810.025900:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.025907:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346c800 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:0.0:1782727810.025910:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.025917:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.025926:0:5939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91fcf9f5b000) 00010000:00010000:0.0:1782727810.025928:0:5939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782727810.025938:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.025943:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64681 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.025955:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727810.025957:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727810.025958:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727810.030584:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.030600:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.030606:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.030611:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346de00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727810.030615:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.030648:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.030665:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff91fcf9f5b200) 00010000:00010000:3.0:1782727810.030667:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727810.030671:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.030676:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64673 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727810.133351:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727810.133491:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329779200 00000100:00100000:2.0:1782727810.133499:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329779200 00000100:00100000:2.0:1782727810.133576:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:2.0:1782727810.133584:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:10931:x1869325329779200:12345-192.168.201.8@tcp:101:multiop.0 00010000:00010000:2.0:1782727810.133615:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727810.133646:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c30 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.133717:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab6468f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.133740:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab6468f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.133754:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab6468f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727810.133810:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727810.133814:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727810.133870:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab6468f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.133896:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c30 expref: 11 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.133927:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab6468f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c30 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.133936:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42b00) 00010000:00010000:2.0:1782727810.133939:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727810.133942:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a76000, rc 0) 00000100:00100000:2.0:1782727810.134008:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:10931:x1869325329779200:12345-192.168.201.8@tcp:101:multiop.0 Request processed in 422us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727810.134015:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:2.0:1782727810.138075:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727810.138327:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329779456 00000100:00100000:3.0:1782727810.138340:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329779456 00000100:00100000:3.0:1782727810.138744:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:3.0:1782727810.138754:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:10931:x1869325329779456:12345-192.168.201.8@tcp:101:multiop.0 00010000:00010000:3.0:1782727810.138772:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727810.138775:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782727810.138798:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab6468f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c30 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.138816:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42b00) 00010000:00010000:3.0:1782727810.138826:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727810.138840:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64696 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c37 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.138936:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6469d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.138950:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6469d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.138974:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6469d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.138987:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.138993:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.138999:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782727810.139333:0:8231:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1782727810.139492:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab646ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139501:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab646ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139508:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab646ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139537:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6469d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139543:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6469d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139549:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6469d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139555:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346dc00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727810.139565:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6469d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139573:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6469d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139580:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcf9f5b200) 00010000:00010000:3.0:1782727810.139583:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727810.139598:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6469d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139604:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6469d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727810.139614:0:8231:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b13e4e63 reply state 00000000afd2c2b1 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727810.139632:0:8231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782727810.139656:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab64696 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c37 expref: 12 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139671:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346ce00/0xb393e873fab646ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c37 expref: 11 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.139677:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91fcf9f5bd00) 00010000:00010000:3.0:1782727810.139679:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727810.139682:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346ce00, rc 0) 00000100:00100000:3.0:1782727810.139758:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+12:10931:x1869325329779456:12345-192.168.201.8@tcp:101:multiop.0 Request processed in 1006us (1692us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1782727810.139766:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 36 00010000:00010000:0.0:1782727810.140494:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727810.145331:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00010000:00010000:2.0:1782727810.145524:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.145537:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.145544:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.145550:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346d200 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727810.145555:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.145564:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.145589:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff91fcf9f5bf00) 00010000:00010000:2.0:1782727810.145592:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727810.145597:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727810.145604:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab646a4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727810.145892:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329779584 00000100:00100000:1.0:1782727810.145902:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329779584 00000100:00100000:1.0:1782727810.145976:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00080000:3.0:1782727810.145979:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727810.145990:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:10931:x1869325329779584:12345-192.168.201.8@tcp:101:multiop.0 00010000:00010000:1.0:1782727810.146011:0:6938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727810.146033:0:6938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000901d6554/0xb393e873fab646b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c3e expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782727810.146058:0:6938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782727810.146095:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=317s v=(0 0) 00010000:00010000:1.0:1782727810.146099:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727810.146109:0:6938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000901d6554/0xb393e873fab646b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c3e expref: 6 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727810.146128:0:6938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000901d6554/0xb393e873fab646b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c3e expref: 6 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727810.146141:0:6938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567b400, rc 0) 00000100:00100000:1.0:1782727810.146206:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10931:x1869325329779584:12345-192.168.201.8@tcp:101:multiop.0 Request processed in 221us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727810.146213:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:1.0:1782727810.159528:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727810.159647:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329779712 00000100:00100000:0.0:1782727810.159657:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329779712 00000100:00100000:0.0:1782727810.159720:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 37 00000100:00100000:0.0:1782727810.159730:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+11:10931:x1869325329779712:12345-192.168.201.8@tcp:44:multiop.0 00000001:00080000:3.0:1782727810.161221:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000004:00080000:3.0:1782727810.161234:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1782727810.161557:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347642624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782727810.161637:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727810.161819:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347642624 00000100:00100000:1.0:1782727810.161826:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347642624 00000100:00100000:1.0:1782727810.161876:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727810.161885:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347642624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782727810.161907:0:6939:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00010000:00010000:1.0:1782727810.161932:0:6939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727810.161953:0:6939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d23475a/0xb393e873fab64657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c22 expref: 6 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727810.161962:0:6939:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782727810.161966:0:6939:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727810.161971:0:6939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727810.162008:0:6939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d23475a/0xb393e873fab64657 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c22 expref: 6 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727810.162022:0:6939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d23475a/0xb393e873fab64657 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c22 expref: 6 pid: 6940 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727810.162035:0:6939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6939:1869325347642752:192.168.201.8@tcp:104: 00000100:00100000:1.0:1782727810.162095:0:6939:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf7d583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727810.163531:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10931:x1869325329779712:12345-192.168.201.8@tcp:44:multiop.0 Request processed in 3796us (4006us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727810.163543:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 37 00000100:00100000:2.0:1782727810.171142:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727810.172737:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329779840 00000100:00100000:0.0:1782727810.172749:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329779840 00010000:00010000:0.0:1782727810.172795:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d23475a/0xb393e873fab64657 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c22 expref: 7 pid: 6940 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727810.172832:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:0.0:1782727810.172852:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe475880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2351:x1869325329779840:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727810.172867:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727810.172873:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d23475a/0xb393e873fab64657 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c22 expref: 7 pid: 6940 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.173001:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d23475a/0xb393e873fab64657 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c22 expref: 7 pid: 6940 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.173026:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727810.173030:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727810.173036:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.173047:0:5936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.173068:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727810.173117:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe475880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2351:x1869325329779840:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 267us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727810.173193:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 29 00010000:00010000:3.0:1782727810.173398:0:6939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d23475a/0xb393e873fab64657 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c22 expref: 6 pid: 6940 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727810.173419:0:6939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6939:1869325347642752:192.168.201.8@tcp:104: 00010000:00010000:3.0:1782727810.173489:0:6939:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.173503:0:6939:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.173511:0:6939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.173523:0:6939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.173532:0:6939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727810.173557:0:6939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782727810.173753:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3445:x1869325347642624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11869us (12116us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782727810.173762:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1782727810.173947:0:3445:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91fcec5d0380/2, rc 0, transno 4294967299 00000100:00100000:2.0:1782727810.173955:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347642624:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782727810.174855:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727810.174866:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.174877:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567ae00 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:0.0:1782727810.174890:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.174901:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.174937:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.174945:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000844ccff1/0xb393e873fab646c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727810.174971:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727810.174973:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727810.174975:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727810.180226:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727810.180531:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329779968 00000100:00100000:3.0:1782727810.180542:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329779968 00000100:00100000:3.0:1782727810.180600:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:3.0:1782727810.180610:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329779968:12345-192.168.201.8@tcp:16:multiop.0 00000100:00100000:3.0:1782727810.180755:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329779968:12345-192.168.201.8@tcp:16:multiop.0 Request processed in 146us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727810.180763:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:1.0:1782727810.186754:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727810.186983:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329780224 00000100:00100000:0.0:1782727810.186993:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329780224 00000100:00100000:0.0:1782727810.187097:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:0.0:1782727810.187120:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:10931:x1869325329780224:12345-192.168.201.8@tcp:35:multiop.0 00000100:00100000:0.0:1782727810.187476:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:10931:x1869325329780224:12345-192.168.201.8@tcp:35:multiop.0 Request processed in 358us (731us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1782727810.187485:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:3.0:1782727810.524087:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347642880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727810.524203:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727810.524352:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347642880 00000100:00100000:0.0:1782727810.524364:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347642880 00000100:00100000:0.0:1782727810.524454:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782727810.524466:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3442:x1869325347642880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727810.524490:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727810.528773:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3442:x1869325347642880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4298us (4558us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727810.528792:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782727810.531256:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347642880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727811.166244:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727811.267053:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727811.267157:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727811.267204:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727811.267320:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329780608 00000100:00100000:3.0:1782727811.267336:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329780608 00000100:00100000:0.0:1782727811.267342:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329780352 00000100:00100000:0.0:1782727811.267364:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329780352 00000100:00100000:3.0:1782727811.267509:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:3.0:1782727811.267527:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329780608:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727811.267543:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 241 00000100:00100000:0.0:1782727811.267561:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329780352:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727811.267674:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2352:x1869325329780608:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 153us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727811.267685:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00080000:2.0:1782727811.267877:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727811.267951:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2353:x1869325329780352:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 124us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727811.267962:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 241 00000100:00100000:1.0:1782727811.268308:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329780480 00000100:00100000:1.0:1782727811.268315:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329780480 00000100:00100000:3.0:1782727811.268459:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 108 00000100:00100000:3.0:1782727811.268473:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2353:x1869325329780480:12345-192.168.201.8@tcp:400:kworker.0 00000100:00080000:2.0:1782727811.268559:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727811.268637:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2353:x1869325329780480:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 166us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727811.268647:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 108 00000100:00100000:0.0:1782727811.270562:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727811.274570:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329780736 00000100:00100000:3.0:1782727811.274593:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329780736 00000100:00100000:3.0:1782727811.275122:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:3.0:1782727811.275328:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329780736:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727811.275484:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329780736:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 160us (4934us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727811.275493:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 47 00010000:00010000:0.0:1782727812.189084:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727813.214461:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782727814.110054:0:8008:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1782727814.236947:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727814.623175:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe46d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347643008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727814.623257:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727814.624560:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347643136:0@lo:400:kworker.0 00000100:00100000:0.0:1782727814.624614:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727814.624654:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727814.624660:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347643264:0@lo:400:kworker.0 00000100:00100000:0.0:1782727814.624681:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727814.624719:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347643136 00000100:00100000:0.0:1782727814.624727:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347643136 00000100:00100000:0.0:1782727814.624781:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782727814.624790:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347643136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727814.624847:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347643136:12345-0@lo:400:kworker.0 Request processed in 58us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727814.624855:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782727814.624910:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347643136:0@lo:400:kworker.0 00000100:00100000:2.0:1782727814.625010:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347643264 00000100:00100000:2.0:1782727814.625015:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347643264 00000100:00100000:2.0:1782727814.625050:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782727814.625057:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347643264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727814.625095:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347643264:12345-0@lo:400:kworker.0 Request processed in 38us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727814.625102:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782727814.626528:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347643264:0@lo:400:kworker.0 00000100:00100000:3.0:1782727814.626643:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727814.626655:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347643392:0@lo:400:kworker.0 00000100:00100000:3.0:1782727814.626706:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727814.626762:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347643008 00000100:00100000:3.0:1782727814.626768:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347643008 00000100:00100000:3.0:1782727814.626818:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727814.626827:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347643008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727814.626860:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727814.626908:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347643008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (3651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727814.626915:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1782727814.626945:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727814.626965:0:3443:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1782727814.626972:0:3443:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91fcfe4daa00, transno 4294967300 00000100:00100000:3.0:1782727814.626985:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe46d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347643008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727814.627143:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347643392 00000100:00100000:0.0:1782727814.627147:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347643392 00000100:00100000:0.0:1782727814.627191:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782727814.627197:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347643392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727814.627234:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325347643392:12345-0@lo:400:kworker.0 Request processed in 37us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727814.627240:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1782727814.627377:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727814.627397:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325347643392:0@lo:400:kworker.0 00000100:00100000:3.0:1782727814.631708:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347643520:0@lo:400:kworker.0 00000100:00100000:3.0:1782727814.631777:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727814.634857:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727814.634887:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347643648:0@lo:400:kworker.0 00000100:00100000:0.0:1782727814.634960:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727814.635058:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347643648 00000100:00100000:1.0:1782727814.635067:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347643648 00000100:00100000:1.0:1782727814.635167:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782727814.635177:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347643648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727814.635236:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347643648:12345-0@lo:400:kworker.0 Request processed in 61us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727814.635243:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782727814.635379:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347643648:0@lo:400:kworker.0 00000100:00100000:3.0:1782727814.641673:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347643520 00000100:00100000:3.0:1782727814.641689:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347643520 00000100:00080000:0.0:1782727814.641765:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727814.641828:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727814.641944:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727814.641959:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3443:x1869325347643520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727814.642208:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3443:x1869325347643520:12345-0@lo:400:kworker.0 Request processed in 254us (10430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727814.642216:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727814.642265:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347643520:0@lo:400:kworker.0 00010000:00010000:0.0:1782727815.259695:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727815.426082:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727815.426276:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329780864 00000100:00100000:0.0:1782727815.426294:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329780864 00000100:00100000:0.0:1782727815.426411:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 38 00000100:00100000:0.0:1782727815.426471:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:11168:x1869325329780864:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1782727815.426497:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727815.426530:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab646c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c45 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727815.426621:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab646ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727815.426635:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab646ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727815.426646:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab646ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727815.426718:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727815.426722:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727815.426760:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab646ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727815.426785:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab646c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c45 expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727815.426806:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab646ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c45 expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727815.426815:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde65000) 00010000:00010000:0.0:1782727815.426818:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727815.426822:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147e600, rc 0) 00000100:00100000:0.0:1782727815.426900:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:11168:x1869325329780864:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 480us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727815.426908:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 38 00000100:00080000:1.0:1782727815.426988:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727815.433473:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727815.433590:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329780992 00000100:00100000:1.0:1782727815.433601:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329780992 00000100:00100000:1.0:1782727815.433667:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:1.0:1782727815.433677:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:11168:x1869325329780992:12345-192.168.201.8@tcp:41:lfs.0 00000004:00000024:1.0:1782727815.433730:0:5951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1782727815.433826:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:11168:x1869325329780992:12345-192.168.201.8@tcp:41:lfs.0 Request processed in 149us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727815.433833:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:3.0:1782727815.440358:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727815.441286:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329781120 00000100:00100000:0.0:1782727815.441305:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329781120 00000100:00100000:0.0:1782727815.441411:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00100000:0.0:1782727815.441456:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:11168:x1869325329781120:12345-192.168.201.8@tcp:13:lfs.0 00002000:00000024:0.0:1782727815.441506:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727815.441634:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:11168:x1869325329781120:12345-192.168.201.8@tcp:13:lfs.0 Request processed in 212us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727815.441642:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00080000:1.0:1782727815.441893:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727815.446456:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727815.446574:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329781248 00000100:00100000:0.0:1782727815.446585:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329781248 00000100:00100000:0.0:1782727815.446663:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00100000:0.0:1782727815.446673:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:11168:x1869325329781248:12345-192.168.201.8@tcp:13:lfs.0 00002000:00000024:0.0:1782727815.446704:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:1.0:1782727815.446872:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727815.446957:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:11168:x1869325329781248:12345-192.168.201.8@tcp:13:lfs.0 Request processed in 284us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727815.446967:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00100000:3.0:1782727815.644779:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727815.644809:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347643776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727815.644908:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727815.645059:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347643776 00000100:00100000:0.0:1782727815.645068:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347643776 00000100:00100000:0.0:1782727815.645145:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782727815.645156:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869325347643776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727815.645187:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727815.645265:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869325347643776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727815.645274:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782727815.646004:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347643776:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1782727816.158977:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967314 is committed 00000001:00080000:0.0:1782727816.165313:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1782727816.165329:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bd37c29-d4cd-43a2-9946-117a0c108d30 00010000:00010000:1.0:1782727816.291258:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727816.384985:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727816.385205:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329781376 00000100:00100000:0.0:1782727816.385216:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329781376 00000100:00100000:0.0:1782727816.385406:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 243 00000100:00100000:0.0:1782727816.385420:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329781376:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727816.385536:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329781376:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 119us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727816.385546:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 243 00000100:00100000:2.0:1782727816.388529:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727816.388651:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329781504 00000100:00100000:3.0:1782727816.388661:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329781504 00000100:00100000:3.0:1782727816.388736:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 112 00000100:00100000:3.0:1782727816.388747:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2350:x1869325329781504:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727816.388861:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2350:x1869325329781504:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 115us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727816.388870:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 112 00000100:00100000:2.0:1782727816.393956:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727816.394017:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727816.394128:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329781760 00000100:00100000:3.0:1782727816.394146:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329781760 00000100:00100000:3.0:1782727816.394228:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329781632 00000100:00100000:3.0:1782727816.394231:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329781632 00000100:00100000:3.0:1782727816.394263:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:3.0:1782727816.394274:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329781760:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727816.394374:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329781760:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 101us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727816.394401:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:3.0:1782727816.394451:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:3.0:1782727816.394459:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2351:x1869325329781632:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727816.394487:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2351:x1869325329781632:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 30us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727816.394493:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 50 00010000:00010000:0.0:1782727817.307800:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727818.331666:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727819.361631:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727819.739685:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727819.739706:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347643904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727819.739770:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727819.739832:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347643904 00000100:00100000:1.0:1782727819.739839:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347643904 00000100:00100000:1.0:1782727819.739889:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782727819.739896:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347643904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727819.739926:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727819.739980:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347643904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727819.739987:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1782727819.740007:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727819.740041:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347643904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727819.740256:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347644160:0@lo:400:kworker.0 00000100:00100000:3.0:1782727819.740292:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727819.740311:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727819.740316:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347644288:0@lo:400:kworker.0 00000100:00100000:3.0:1782727819.740336:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727819.740362:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347644160 00000100:00100000:3.0:1782727819.740365:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347644160 00000100:00100000:3.0:1782727819.740392:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347644288 00000100:00100000:3.0:1782727819.740394:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347644288 00000100:00100000:3.0:1782727819.740417:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782727819.740450:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347644160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727819.740496:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325347644160:12345-0@lo:400:kworker.0 Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727819.740503:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782727819.740516:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782727819.740522:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347644288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727819.740543:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347644288:12345-0@lo:400:kworker.0 Request processed in 22us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727819.740548:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782727819.740590:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347644288:0@lo:400:kworker.0 00000100:00100000:3.0:1782727819.740599:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325347644160:0@lo:400:kworker.0 00000100:00080000:1.0:1782727819.740751:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727819.740761:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347644032:0@lo:400:kworker.0 00000100:00100000:1.0:1782727819.740795:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727819.740830:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347644544:0@lo:400:kworker.0 00000100:00100000:1.0:1782727819.740855:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727819.740874:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727819.740887:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcc33eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347644416:0@lo:400:kworker.0 00000100:00100000:1.0:1782727819.740915:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727819.740957:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347644416 00000100:00100000:1.0:1782727819.740962:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347644416 00000100:00100000:1.0:1782727819.740999:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782727819.741005:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347644416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727819.741044:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347644416:12345-0@lo:400:kworker.0 Request processed in 39us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727819.741050:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1782727819.741068:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727819.741076:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347644544 00000100:00100000:1.0:1782727819.741079:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347644544 00000100:00100000:1.0:1782727819.741105:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782727819.741111:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347644544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727819.741139:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347644544:12345-0@lo:400:kworker.0 Request processed in 28us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727819.741144:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1782727819.741159:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727819.741173:0:3443:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000004:00080000:1.0:1782727819.741178:0:3443:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91fcec5d0380, transno 4294967299 00000100:00100000:1.0:1782727819.741200:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347644416:0@lo:400:kworker.0 00000100:00100000:1.0:1782727819.741212:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcc33ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347644544:0@lo:400:kworker.0 00000100:00100000:3.0:1782727819.741561:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347644032 00000100:00100000:3.0:1782727819.741566:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347644032 00000100:00100000:3.0:1782727819.741603:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1782727819.741610:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347644032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727819.741652:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3443:x1869325347644032:12345-0@lo:400:kworker.0 Request processed in 43us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727819.741657:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1782727819.741734:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3443:1869325347644032:0@lo:400:kworker.0 00010000:00010000:0.0:1782727820.379859:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727820.764100:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727820.768531:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347644672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727820.768626:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727820.771352:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347644672 00000100:00100000:0.0:1782727820.771372:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347644672 00000100:00100000:0.0:1782727820.771551:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782727820.771562:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347644672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727820.771599:0:6941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727820.771699:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347644672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727820.771706:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727820.771825:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347644672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727820.856588:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727820.856904:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329781888 00000100:00100000:3.0:1782727820.856914:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329781888 00000100:00100000:3.0:1782727820.857074:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:3.0:1782727820.857084:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:11594:x1869325329781888:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:3.0:1782727820.857106:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727820.857330:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab646d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c4c expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857405:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab646dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857420:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab646dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857478:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab646dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857546:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab646e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857574:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab646e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857582:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab646e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857643:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab646dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857651:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab646dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857658:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab646dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857665:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346de00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727820.857670:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab646dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857679:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab646dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857693:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde65000) 00010000:00010000:3.0:1782727820.857696:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727820.857702:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab646dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857708:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab646dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857722:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab646e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857733:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab646e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857740:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab646e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857744:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346cc00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727820.857747:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab646e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857753:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab646e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857764:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff91fcd0ad3100) 00010000:00010000:3.0:1782727820.857767:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727820.857770:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab646e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857775:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab646e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857817:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab646d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c4c expref: 8 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857829:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde65000) 00010000:00010000:3.0:1782727820.857832:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782727820.857836:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab646d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c4c expref: 8 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727820.857845:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346dc00, rc 0) 00000100:00100000:3.0:1782727820.858051:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:11594:x1869325329781888:12345-192.168.201.8@tcp:101:rm.0 Request processed in 966us (1471us total) trans 0 rc 301/301 00000100:00100000:3.0:1782727820.858060:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00080000:1.0:1782727820.858189:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727821.403711:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727821.506156:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727821.506214:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727821.506488:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329782144 00000100:00100000:1.0:1782727821.506500:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329782144 00000100:00100000:1.0:1782727821.506566:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 116 00000100:00100000:1.0:1782727821.506576:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2351:x1869325329782144:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727821.506658:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2351:x1869325329782144:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 83us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727821.506665:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 116 00000100:00100000:3.0:1782727821.507319:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329782400 00000100:00100000:3.0:1782727821.507325:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329782400 00000100:00100000:3.0:1782727821.507377:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:3.0:1782727821.507386:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329782400:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727821.507473:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329782400:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 88us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727821.507479:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:3.0:1782727821.507527:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727821.507853:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329782016 00000100:00100000:0.0:1782727821.507859:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329782016 00000100:00100000:0.0:1782727821.507908:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 245 00000100:00100000:0.0:1782727821.507916:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329782016:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727821.507956:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329782016:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 42us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727821.507963:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 245 00000100:00080000:1.0:1782727821.508392:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727821.513118:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727821.513236:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329782272 00000100:00100000:1.0:1782727821.513246:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329782272 00000100:00100000:1.0:1782727821.513326:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00100000:1.0:1782727821.513337:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2351:x1869325329782272:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727821.513471:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:2351:x1869325329782272:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727821.513480:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00080000:2.0:1782727821.513552:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782727822.428940:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727822.946282:0:12595:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 118c: Fsync blocks on EROFS until dirty pages are flushed ==================================================================== 06:10:21 (1782727821) 00010000:00010000:0.0:1782727823.451641:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727823.557925:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727823.558659:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329782656 00000100:00100000:1.0:1782727823.558669:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329782656 00000100:00100000:1.0:1782727823.558758:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:1.0:1782727823.558769:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:11844:x1869325329782656:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1782727823.558790:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727823.558794:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782727823.558826:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab646ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c45 expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.558868:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde65000) 00010000:00010000:1.0:1782727823.558893:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727823.558909:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab646ea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c53 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559017:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab646f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559031:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab646f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559042:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab646f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559055:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559062:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559069:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559523:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559534:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559541:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727823.559558:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:1.0:1782727823.559581:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab646f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559588:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab646f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559595:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab646f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559601:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567aa00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727823.559605:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab646f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559612:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab646f1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559621:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fce0ba7d00) 00010000:00010000:1.0:1782727823.559625:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727823.559629:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab646f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559636:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab646f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727823.559646:0:5951:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a431cd8c reply state 000000001f5d90fd transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727823.559656:0:5951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782727823.559696:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab646ea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c53 expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559723:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c53 expref: 8 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.559732:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7b00) 00010000:00010000:1.0:1782727823.559734:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782727823.559737:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567a800, rc 0) 00000100:00100000:1.0:1782727823.559808:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:11844:x1869325329782656:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1040us (1892us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1782727823.559817:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00080000:2.0:1782727823.560349:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727823.562245:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.562262:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.562270:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.562276:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567a200 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727823.562281:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.562289:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.562306:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff91fce0ba7100) 00010000:00010000:3.0:1782727823.562321:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727823.562326:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.562333:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab646f8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727823.565836:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727823.566000:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329782912 00000100:00100000:1.0:1782727823.566012:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329782912 00000100:00100000:1.0:1782727823.566099:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:1.0:1782727823.566110:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:11844:x1869325329782912:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1782727823.566139:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727823.566168:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6470d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c5a expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.566306:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.566326:0:5952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c53 expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.566337:0:5952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.566379:0:5952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c53 expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.566451:0:5952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c53 expref: 9 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727823.566471:0:5952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcf7da1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5952:1869325347644800:192.168.201.8@tcp:104: 00000100:00100000:1.0:1782727823.566605:0:5952:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf7d58b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727823.570254:0:5952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcf7da1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5952:1869325347644800:192.168.201.8@tcp:104: 00010000:00010000:1.0:1782727823.570292:0:5952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727823.572333:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727823.572671:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329783040 00000100:00100000:0.0:1782727823.572683:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329783040 00010000:00010000:0.0:1782727823.572738:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c53 expref: 10 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727823.572788:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00100000:0.0:1782727823.572798:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:2352:x1869325329783040:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727823.572831:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727823.572839:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c53 expref: 10 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.572855:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c53 expref: 10 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.572892:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab646ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c53 expref: 10 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.572910:0:5936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7b00) 00010000:00010000:0.0:1782727823.572916:0:5936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.572927:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.572936:0:5936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.572971:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727823.573047:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:2352:x1869325329783040:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 249us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727823.573055:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 30 00010000:00010000:1.0:1782727823.573255:0:5952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.573264:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727823.573283:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00000004:00080000:1.0:1782727823.573586:0:5952:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00000004:00080000:1.0:1782727823.573593:0:5952:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1782727823.573684:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.573693:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.573700:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.573706:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc0031200 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727823.573716:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.573725:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.573735:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7b00) 00010000:00010000:1.0:1782727823.573738:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782727823.573742:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.573748:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab64714 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.573801:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6470d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c5a expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.573810:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fce0ba7c00) 00010000:00010000:1.0:1782727823.573813:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782727823.573816:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab6470d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c5a expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.573826:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567ae00, rc 0) 00000100:00100000:1.0:1782727823.573857:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:11844:x1869325329782912:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 7749us (8033us total) trans 4294967316 rc 301/301 00000100:00100000:1.0:1782727823.573865:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:0.0:1782727823.577278:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727823.577467:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329783296 00000100:00100000:1.0:1782727823.577479:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329783296 00000100:00100000:1.0:1782727823.577549:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:1.0:1782727823.577560:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:11844:x1869325329783296:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:1.0:1782727823.577893:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:11844:x1869325329783296:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 334us (624us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1782727823.577901:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:3.0:1782727823.579748:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727823.579943:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329783424 00000100:00100000:1.0:1782727823.579953:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329783424 00000100:00100000:1.0:1782727823.580056:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:1.0:1782727823.580069:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:11844:x1869325329783424:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1782727823.580098:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727823.580139:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0030a00/0xb393e873fab64722 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c61 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.580199:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0030a00/0xb393e873fab64722 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c61 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.580215:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0030a00/0xb393e873fab64722 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c61 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.580236:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7d00) 00010000:00010000:1.0:1782727823.580239:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782727823.580243:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0030a00, rc 0) 00000100:00100000:1.0:1782727823.580312:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:11844:x1869325329783424:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 246us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727823.580317:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:0.0:1782727823.584765:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727823.584874:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329783680 00000100:00100000:1.0:1782727823.584896:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329783680 00000100:00100000:1.0:1782727823.585022:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:1.0:1782727823.585034:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:11844:x1869325329783680:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:1.0:1782727823.585313:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+11:11844:x1869325329783680:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 280us (560us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1782727823.585321:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:0.0:1782727823.596918:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727823.597016:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329783808 00000100:00100000:3.0:1782727823.597027:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329783808 00000100:00100000:3.0:1782727823.597098:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:3.0:1782727823.597110:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+11:11846:x1869325329783808:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:3.0:1782727823.597152:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727823.597182:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab64729 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c68 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.597273:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64730 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.597289:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.597301:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727823.597364:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727823.597368:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727823.597407:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.597505:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab64729 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c68 expref: 13 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.597550:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c68 expref: 12 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.597560:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3100) 00010000:00010000:3.0:1782727823.597564:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727823.597567:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346cc00, rc 0) 00000100:00100000:3.0:1782727823.597632:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+12:11846:x1869325329783808:12345-192.168.201.8@tcp:101:dd.0 Request processed in 525us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727823.597641:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:3.0:1782727823.608307:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727823.608464:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329784064 00000100:00100000:2.0:1782727823.608485:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329784064 00000100:00100000:2.0:1782727823.608587:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 45 00000100:00100000:2.0:1782727823.608598:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+12:11846:x1869325329784064:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:2.0:1782727823.608617:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727823.608620:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782727823.608645:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64730 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c68 expref: 12 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.608666:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3100) 00010000:00010000:2.0:1782727823.608676:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727823.608691:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64737 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c6f expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.608839:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6473e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.608855:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6473e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.608865:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6473e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609017:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64745 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609027:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609036:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609110:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab6474c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609119:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab6474c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609135:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab6474c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727823.609148:0:8231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:2.0:1782727823.609251:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6473e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609259:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6473e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609267:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6473e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609274:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a77400 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727823.609279:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6473e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609288:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6473e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609297:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42000) 00010000:00010000:2.0:1782727823.609300:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727823.609303:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6473e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609321:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab6473e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609334:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609339:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64745 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609343:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64745 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609347:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a77e00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727823.609350:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64745 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609354:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64745 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609361:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff91fcd3c42c00) 00010000:00010000:2.0:1782727823.609364:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727823.609366:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64745 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609371:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64745 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609523:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab64737 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c6f expref: 14 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609541:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab6474c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c6f expref: 13 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.609555:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7d00) 00010000:00010000:2.0:1782727823.609558:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727823.609561:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a76600, rc 0) 00000100:00100000:2.0:1782727823.609643:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+13:11846:x1869325329784064:12345-192.168.201.8@tcp:101:dd.0 Request processed in 1046us (1345us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1782727823.609652:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 45 00000100:00100000:0.0:1782727823.614600:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727823.614757:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329784192 00000100:00100000:1.0:1782727823.614767:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329784192 00000100:00100000:1.0:1782727823.614851:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:1.0:1782727823.614858:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+13:11846:x1869325329784192:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:1.0:1782727823.614879:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727823.614906:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab6475a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c76 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.614940:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab64761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.614954:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab64761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.614966:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab64761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.615117:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0031200/0xb393e873fab6475a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c76 expref: 15 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.615148:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab64761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c76 expref: 14 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.615160:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7d00) 00010000:00010000:1.0:1782727823.615164:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782727823.615174:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567ae00, rc 0) 00000100:00100000:1.0:1782727823.615254:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+14:11846:x1869325329784192:12345-192.168.201.8@tcp:101:dd.0 Request processed in 396us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727823.615262:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:3.0:1782727823.619590:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727823.620211:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329784448 00000100:00100000:1.0:1782727823.620222:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329784448 00000100:00100000:1.0:1782727823.620359:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:1.0:1782727823.620372:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc33eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+14:11846:x1869325329784448:12345-192.168.201.8@tcp:36:dd.0 00010000:00010000:1.0:1782727823.620532:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727823.620557:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab6474c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c6f expref: 14 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.620572:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7d00) 00010000:00010000:1.0:1782727823.620575:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727823.620740:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.620754:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.620764:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782727823.620816:0:5951:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000004:00010000:1.0:1782727823.620841:0:5951:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052531db5 reply state 00000000e16542fa transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727823.620849:0:5951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782727823.620977:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc33eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:11846:x1869325329784448:12345-192.168.201.8@tcp:36:dd.0 Request processed in 608us (1395us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1782727823.621013:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 47 00000020:00080000:1.0:1782727823.621020:0:5951:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782727823.623906:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727823.624005:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329784576 00000100:00100000:0.0:1782727823.624029:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329784576 00000100:00100000:0.0:1782727823.624111:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:0.0:1782727823.624121:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:11846:x1869325329784576:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:0.0:1782727823.624147:0:6938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727823.624168:0:6938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4140af0/0xb393e873fab6476f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c7d expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782727823.624193:0:6938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782727823.624215:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1782727823.624219:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782727823.624227:0:6938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4140af0/0xb393e873fab6476f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c7d expref: 6 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.624244:0:6938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4140af0/0xb393e873fab6476f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c7d expref: 6 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.624258:0:6938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147fc00, rc 0) 00000100:00100000:0.0:1782727823.624310:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:11846:x1869325329784576:12345-192.168.201.8@tcp:101:dd.0 Request processed in 190us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727823.624316:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00080000:3.0:1782727823.624506:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782727823.624896:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.624909:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.624917:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.624923:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567a800 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727823.624929:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.624938:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.624955:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7d00) 00010000:00010000:2.0:1782727823.624959:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727823.624964:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.624970:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64768 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727823.630171:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727823.630317:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329784704 00000100:00100000:3.0:1782727823.630331:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329784704 00000100:00100000:3.0:1782727823.630464:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:3.0:1782727823.630476:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:11846:x1869325329784704:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:3.0:1782727823.630504:0:6940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727823.630531:0:6940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3ff2672/0xb393e873fab64776 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c84 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782727823.630561:0:6940:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782727823.630584:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1782727823.630588:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782727823.630597:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3ff2672/0xb393e873fab64776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c84 expref: 7 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.630639:0:6940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3ff2672/0xb393e873fab64776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c84 expref: 7 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.630653:0:6940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346dc00, rc 0) 00000100:00100000:3.0:1782727823.630715:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:11846:x1869325329784704:12345-192.168.201.8@tcp:101:dd.0 Request processed in 241us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727823.630723:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00080000:2.0:1782727823.631241:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727823.636297:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727823.636639:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329784832 00000100:00100000:1.0:1782727823.636651:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329784832 00002000:00010000:1.0:1782727823.636704:0:6943:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1782727823.636710:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe46d880 with x1869325329784832 ext(0->18446744073709551615) 00002000:00010000:1.0:1782727823.636728:0:6943:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe46d880. 00000100:00100000:1.0:1782727823.636771:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:1.0:1782727823.636782:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2350:x1869325329784832:12345-192.168.201.8@tcp:10:dd.0 00002000:00010000:1.0:1782727823.637013:0:6943:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782727823.637017:0:6943:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782727823 00002000:00010000:1.0:1782727823.637020:0:6943:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782727823.637022:0:6943:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782727823 00002000:00010000:1.0:1782727823.637024:0:6943:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1782727823.637101:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2350:x1869325329784832:12345-192.168.201.8@tcp:10:dd.0 Request processed in 320us (816us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782727823.637110:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00002000:00010000:1.0:1782727823.637114:0:6943:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1782727823.637116:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe46d880 with x1869325329784832 ext(0->18446744073709551615) 00002000:00010000:1.0:1782727823.637121:0:6943:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe46d880. 00000100:00100000:1.0:1782727823.640115:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727823.640281:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329784960 00000100:00100000:2.0:1782727823.640291:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329784960 00002000:00010000:2.0:1782727823.640325:0:6945:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:2.0:1782727823.640330:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcf7da1f80 with x1869325329784960 ext(0->18446744073709551615) 00002000:00010000:2.0:1782727823.640342:0:6945:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91fcf7da1f80. 00000100:00100000:2.0:1782727823.640372:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:2.0:1782727823.640381:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2351:x1869325329784960:12345-192.168.201.8@tcp:10:dd.0 00002000:00010000:2.0:1782727823.640662:0:6945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782727823.640666:0:6945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782727823 00002000:00010000:2.0:1782727823.640669:0:6945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782727823.640670:0:6945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782727823 00002000:00010000:2.0:1782727823.640672:0:6945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782727823.640745:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:2351:x1869325329784960:12345-192.168.201.8@tcp:10:dd.0 Request processed in 363us (642us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782727823.640753:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 1 00002000:00010000:2.0:1782727823.640757:0:6945:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:2.0:1782727823.640759:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcf7da1f80 with x1869325329784960 ext(0->18446744073709551615) 00002000:00010000:2.0:1782727823.640764:0:6945:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91fcf7da1f80. 00000100:00100000:0.0:1782727823.660764:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727823.661559:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329785216 00000100:00100000:2.0:1782727823.661572:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329785216 00000100:00100000:2.0:1782727823.661639:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:2.0:1782727823.661651:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fced2c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+15:11846:x1869325329785216:12345-192.168.201.8@tcp:35:dd.0 00000100:00100000:2.0:1782727823.662111:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fced2c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:11846:x1869325329785216:12345-192.168.201.8@tcp:35:dd.0 Request processed in 461us (1356us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1782727823.662151:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:0.0:1782727823.679247:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727823.679461:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329785344 00000100:00100000:2.0:1782727823.679473:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329785344 00002000:00100000:2.0:1782727823.679535:0:6944:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->131071) req@ffff91fcfe46ed80 x1869325329785344/t0(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:694/0 lens 488/0 e 0 to 0 dl 1782727834 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727823.679547:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe46ed80 with x1869325329785344 ext(0->131071) 00002000:00010000:2.0:1782727823.679554:0:6944:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe46ed80 00000100:00100000:2.0:1782727823.679599:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:2.0:1782727823.679610:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2353:x1869325329785344:12345-192.168.201.8@tcp:4:dd.0 00000100:00100000:2.0:1782727823.693375:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:2353:x1869325329785344:12345-192.168.201.8@tcp:4:dd.0 Request processed in 13754us (14129us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782727823.693390:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 2 00002000:00100000:2.0:1782727823.693414:0:6944:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->131071) req@ffff91fcfe46ed80 x1869325329785344/t4294967301(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:694/0 lens 488/448 e 0 to 0 dl 1782727834 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727823.693444:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe46ed80 with x1869325329785344 ext(0->131071) 00002000:00010000:2.0:1782727823.693451:0:6944:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe46ed80 00000100:00100000:1.0:1782727823.715762:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727823.715969:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329785472 00000100:00100000:3.0:1782727823.715987:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329785472 00000100:00100000:3.0:1782727823.716050:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:3.0:1782727823.716061:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:11848:x1869325329785472:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:3.0:1782727823.716325:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727823.716350:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6477d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c8b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.716522:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64784 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.716537:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.716549:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727823.716594:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727823.716598:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727823.716616:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.716652:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6477d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c8b expref: 18 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.716669:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c8b expref: 17 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.716677:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3800) 00010000:00010000:3.0:1782727823.716680:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727823.716683:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346cc00, rc 0) 00000100:00100000:3.0:1782727823.716838:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+17:11848:x1869325329785472:12345-192.168.201.8@tcp:101:rm.0 Request processed in 778us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727823.716846:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:0.0:1782727823.722728:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727823.722852:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329785600 00000100:00100000:2.0:1782727823.722862:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329785600 00000100:00100000:2.0:1782727823.724525:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:2.0:1782727823.724546:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+17:11848:x1869325329785600:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:2.0:1782727823.724569:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727823.724593:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab6478b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c92 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.724689:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64792 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.724705:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64792 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.724718:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64792 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.724733:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64799 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.724741:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.724748:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.724834:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.724843:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.724849:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727823.725111:0:8231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 131072 00000004:00200000:2.0:1782727823.725116:0:8231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727823.725407:0:8231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725604:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725613:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64792 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725619:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64792 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725626:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64792 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725631:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a77e00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727823.725635:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64792 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725641:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64792 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725653:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3800) 00010000:00010000:2.0:1782727823.725656:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727823.725660:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725666:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab64792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725678:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725684:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64799 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725696:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64799 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725700:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a77400 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727823.725703:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64799 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725709:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64799 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725717:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff91fcd3c42000) 00010000:00010000:2.0:1782727823.725720:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727823.725723:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64799 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725728:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab64799 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725764:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76000/0xb393e873fab6478b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c92 expref: 19 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725779:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c92 expref: 18 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727823.725786:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7d00) 00010000:00010000:2.0:1782727823.725788:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727823.725791:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77c00, rc 0) 00000100:00100000:2.0:1782727823.725993:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+18:11848:x1869325329785600:12345-192.168.201.8@tcp:101:rm.0 Request processed in 1453us (3273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727823.726010:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:0.0:1782727823.755735:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727823.756536:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329785856 00000100:00100000:1.0:1782727823.756547:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329785856 00000100:00100000:1.0:1782727823.756616:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:1.0:1782727823.756625:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+18:11848:x1869325329785856:12345-192.168.201.8@tcp:36:rm.0 00010000:00010000:1.0:1782727823.756704:0:5952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1782727823.756747:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c92 expref: 18 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.756772:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab64761 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c76 expref: 17 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.756792:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc0030a00/0xb393e873fab64722 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c61 expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.756804:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7d00) 00010000:00010000:1.0:1782727823.756820:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64784 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c8b expref: 15 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.756829:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3800) 00010000:00010000:1.0:1782727823.756836:0:5952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727823.756862:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab647a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.756882:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab647a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.756893:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab647a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.756910:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.756917:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.756931:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.757295:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab647b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.757304:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab647b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.757312:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab647b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782727823.758468:0:5952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1782727823.758482:0:5952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330643057457ns, next at 331643054485ns, rc = 0 00000040:00080000:1.0:1782727823.758506:0:5952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1782727823.758512:0:5952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330643088460ns, next at 331643087452ns, rc = 0 00010000:00010000:1.0:1782727823.758575:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.758589:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.758598:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.758607:0:5952:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.758613:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.758637:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.758662:0:5952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782727823.758689:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab647b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.758695:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab647b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.758702:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab647b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.758708:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567a800 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727823.758713:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab647b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.758886:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727823.758897:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.758904:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567a200 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:0.0:1782727823.758907:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.758916:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.758929:0:5939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7f00) 00010000:00010000:0.0:1782727823.758932:0:5939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782727823.758936:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.758941:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab647bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727823.758956:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727823.758958:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727823.758960:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727823.760243:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab647b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.760259:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff91fce0ba7f00) 00010000:00010000:1.0:1782727823.760262:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782727823.760265:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab647b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.760271:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab647b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.760307:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab647a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.760314:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab647a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.765774:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab647a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.765782:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567aa00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727823.765788:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab647a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.765799:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab647a7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.765828:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fce0ba7c00) 00010000:00010000:1.0:1782727823.765832:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727823.765838:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab647a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727823.765847:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab647a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727823.765893:0:5952:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dd941a1e reply state 000000003547fb69 transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727823.765908:0:5952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782727823.766561:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:11848:x1869325329785856:12345-192.168.201.8@tcp:36:rm.0 Request processed in 9928us (10825us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1782727823.766572:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 50 00010000:00010000:3.0:1782727823.774108:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.774252:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.774260:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.774266:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567b600 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727823.774271:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.774279:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.774296:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff91fce0ba7b00) 00010000:00010000:3.0:1782727823.774315:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727823.774320:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727823.774327:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567b600/0xb393e873fab647ae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.483377:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782727824.860172:0:8369:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331744743467ns, next at 332744738879ns, rc = 0 00000100:00100000:0.0:1782727824.860291:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727824.860322:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe46f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347644928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727824.860487:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727824.860592:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347644928 00000100:00100000:0.0:1782727824.860604:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347644928 00000100:00100000:0.0:1782727824.860687:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782727824.860702:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347644928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727824.860754:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727824.860818:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347644928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727824.860838:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1782727824.861993:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727824.862954:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe46f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347644928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727824.863883:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347645056:0@lo:400:kworker.0 00000100:00100000:2.0:1782727824.863988:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727824.864053:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727824.864061:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347645184:0@lo:400:kworker.0 00000001:00080000:0.0:1782727824.864494:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967323 is committed 00000004:00080000:0.0:1782727824.864506:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1782727824.864523:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1782727824.864765:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347645056 00000100:00100000:1.0:1782727824.864780:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347645056 00000100:00100000:2.0:1782727824.864947:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727824.865016:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347645184 00000100:00100000:2.0:1782727824.865021:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347645184 00000100:00100000:2.0:1782727824.865067:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782727824.865078:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347645184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727824.865235:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1782727824.865246:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347645056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727824.865497:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727824.865511:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347645568:0@lo:400:kworker.0 00000100:00100000:3.0:1782727824.865568:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727824.865673:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347645440:0@lo:400:kworker.0 00000100:00100000:3.0:1782727824.865708:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727824.865731:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727824.865737:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325347645312:0@lo:400:kworker.0 00000100:00100000:3.0:1782727824.865764:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727824.865800:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347645568 00000100:00100000:3.0:1782727824.865806:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347645568 00000100:00100000:3.0:1782727824.865845:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347645312 00000100:00100000:3.0:1782727824.865848:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347645312 00000100:00100000:3.0:1782727824.865880:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782727824.865886:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347645568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727824.865934:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325347645568:12345-0@lo:400:kworker.0 Request processed in 46us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727824.865942:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782727824.865962:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782727824.865967:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325347645312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727824.866001:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325347645312:12345-0@lo:400:kworker.0 Request processed in 33us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727824.866019:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782727824.866040:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347645696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782727824.866068:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727824.866349:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347645056:12345-0@lo:400:kworker.0 Request processed in 1106us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727824.866357:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1782727824.866560:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347645184:12345-0@lo:400:kworker.0 Request processed in 1483us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727824.866569:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782727824.866615:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347645184:0@lo:400:kworker.0 00000100:00100000:2.0:1782727824.866629:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347645056:0@lo:400:kworker.0 00000100:00100000:3.0:1782727824.867386:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325347645568:0@lo:400:kworker.0 00000100:00100000:3.0:1782727824.867443:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347645440 00000100:00100000:3.0:1782727824.867450:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347645440 00000100:00100000:3.0:1782727824.867497:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347645696 00000100:00100000:3.0:1782727824.867500:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347645696 00000100:00100000:3.0:1782727824.867516:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727824.867523:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347645440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727824.867576:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347645440:12345-0@lo:400:kworker.0 Request processed in 53us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727824.867583:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727824.867596:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727824.867602:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347645696:12345-0@lo:6:osp-syn-1-0.0 00002000:02000000:3.0:1782727824.867624:0:6939:0:(ofd_dev.c:1834:ofd_destroy_hdl()) *** cfs_fail_loc=216, val=0*** 00000100:00100000:0.0:1782727824.868910:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347645824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782727824.869000:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727824.871775:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347645696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4159us (5692us total) trans 0 rc -30/-30 00000100:00100000:3.0:1782727824.871792:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727824.871830:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347645824 00000100:00100000:3.0:1782727824.871839:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347645824 00000100:00100000:3.0:1782727824.871906:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727824.871915:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347645824:12345-0@lo:6:osp-syn-0-0.0 00002000:02000000:3.0:1782727824.871958:0:6939:0:(ofd_dev.c:1834:ofd_destroy_hdl()) *** cfs_fail_loc=216, val=0*** 00000100:00100000:3.0:1782727824.871994:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347645824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 80us (2996us total) trans 0 rc -30/-30 00000100:00100000:3.0:1782727824.872026:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1782727824.872050:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727824.872059:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727824.872236:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325347645312:0@lo:400:kworker.0 00000100:00100000:3.0:1782727824.872260:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347645440:0@lo:400:kworker.0 00000004:00080000:1.0:1782727824.872555:0:3444:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91fcfe4da300, transno 0 00000004:00080000:1.0:1782727824.872563:0:3444:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91fcfe4da300/1, rc -30, transno 0 00000100:00100000:1.0:1782727824.872585:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347645824:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782727824.879666:0:3443:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91fcfe636d80, transno 0 00000004:00080000:0.0:1782727824.879693:0:3443:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91fcfe636d80/1, rc -30, transno 0 00000100:00100000:0.0:1782727824.880458:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347645696:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782727824.888415:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727824.888619:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329785984 00000100:00100000:2.0:1782727824.888634:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329785984 00000100:00100000:2.0:1782727824.888723:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00100000:2.0:1782727824.888739:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:11890:x1869325329785984:12345-192.168.201.8@tcp:101:multiop.0 00010000:00010000:2.0:1782727824.888779:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727824.888812:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab647c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488c99 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.888929:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab647ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.888957:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab647ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.888972:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab647ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727824.889043:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727824.889047:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727824.889076:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab647ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.889115:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77400/0xb393e873fab647c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c99 expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.889141:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab647ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c99 expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.889153:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42000) 00010000:00010000:2.0:1782727824.889157:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727824.889162:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77e00, rc 0) 00000100:00100000:2.0:1782727824.889275:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:11890:x1869325329785984:12345-192.168.201.8@tcp:101:multiop.0 Request processed in 539us (6189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727824.889294:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00100000:2.0:1782727824.898175:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727824.898329:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329786240 00000100:00100000:3.0:1782727824.898344:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329786240 00000100:00100000:3.0:1782727824.898622:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:3.0:1782727824.898639:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:11890:x1869325329786240:12345-192.168.201.8@tcp:101:multiop.0 00010000:00010000:3.0:1782727824.898671:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727824.898676:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782727824.898714:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77e00/0xb393e873fab647ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c99 expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.898739:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42000) 00010000:00010000:3.0:1782727824.898753:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727824.898776:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab647d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488ca0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.898929:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab647d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.898946:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab647d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.898958:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab647d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.898991:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.898998:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.899005:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782727824.900075:0:5951:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1782727824.900538:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900557:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900581:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900627:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab647d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900635:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab647d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900644:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab647d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900650:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346de00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727824.900655:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab647d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900664:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab647d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900676:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3c00) 00010000:00010000:2.0:1782727824.900679:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727824.900684:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab647d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900690:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab647d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727824.900705:0:5951:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e596dc28 reply state 00000000fe5340ee transno 4294967324 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727824.900716:0:5951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782727824.900766:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab647d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca0 expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900789:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca0 expref: 8 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727824.900798:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91fcd3c42c00) 00010000:00010000:2.0:1782727824.900800:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727824.900803:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77c00, rc 0) 00000100:00100000:2.0:1782727824.901203:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:11890:x1869325329786240:12345-192.168.201.8@tcp:101:multiop.0 Request processed in 2567us (3040us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1782727824.901214:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 52 00010000:00010000:3.0:1782727824.908369:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.908405:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.908415:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.908463:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346c800 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727824.908470:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.908481:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.908504:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11a4e1a9 (ffff91fcd0ad3700) 00010000:00010000:3.0:1782727824.908508:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727824.908513:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727824.908520:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab647df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727824.931545:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727824.931714:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329786368 00000100:00100000:1.0:1782727824.931730:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329786368 00000100:00100000:1.0:1782727824.931812:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:1.0:1782727824.931824:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:11890:x1869325329786368:12345-192.168.201.8@tcp:101:multiop.0 00010000:00010000:1.0:1782727824.931849:0:6939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727824.931879:0:6939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8587211/0xb393e873fab647f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488ca7 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782727824.931917:0:6939:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782727824.931954:0:6939:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:1.0:1782727824.931959:0:6939:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727824.931971:0:6939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8587211/0xb393e873fab647f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca7 expref: 10 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727824.931992:0:6939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8587211/0xb393e873fab647f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca7 expref: 10 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727824.932007:0:6939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc0030a00, rc 0) 00000100:00100000:1.0:1782727824.932083:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:11890:x1869325329786368:12345-192.168.201.8@tcp:101:multiop.0 Request processed in 261us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727824.932128:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:3.0:1782727824.945047:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727824.945149:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329786496 00000100:00100000:0.0:1782727824.945165:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329786496 00002000:00100000:0.0:1782727824.945236:0:6943:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91fcfe637480 x1869325329786496/t0(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:695/0 lens 4584/0 e 0 to 0 dl 1782727835 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782727824.945251:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe637480 with x1869325329786496 ext(0->4095) 00002000:00010000:0.0:1782727824.945257:0:6943:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe637480 00000100:00100000:0.0:1782727824.945304:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:0.0:1782727824.945315:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:2352:x1869325329786496:12345-192.168.201.8@tcp:4:multiop.0 00000001:00020000:0.0:1782727824.945332:0:6943:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 sleeping for 1000ms 00010000:00010000:0.0:1782727825.502642:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727825.884046:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727825.884080:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347645952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727825.884181:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727825.884715:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347645952 00000100:00100000:2.0:1782727825.884727:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347645952 00000100:00100000:2.0:1782727825.884810:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782727825.884824:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347645952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727825.884867:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125952 pending 155648 free 3923537920 avail 3692015616 00000100:00100000:2.0:1782727825.884940:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325347645952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727825.884948:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782727825.885013:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347645952:0@lo:13:osp-pre-0-0.0 00000001:00020000:1.0:1782727825.996321:0:6943:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 awake 00000100:00100000:1.0:1782727826.004727:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:2352:x1869325329786496:12345-192.168.201.8@tcp:4:multiop.0 Request processed in 1059398us (1059684us total) trans 0 rc -30/-30 00000100:00100000:1.0:1782727826.004744:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 3 00002000:00100000:1.0:1782727826.004762:0:6943:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91fcfe637480 x1869325329786496/t0(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:695/0 lens 4584/224 e 0 to 0 dl 1782727835 ref 1 fl Complete:/600/0 rc -30/-30 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782727826.004773:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe637480 with x1869325329786496 ext(0->4095) 00002000:00010000:1.0:1782727826.004782:0:6943:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe637480 00010000:00010000:2.0:1782727826.524763:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727826.638556:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727826.638614:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727826.638670:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727826.638706:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727826.638768:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329787136 00000100:00100000:0.0:1782727826.638784:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329787136 00000100:00100000:0.0:1782727826.638878:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329787008 00000100:00100000:0.0:1782727826.638881:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329787008 00000100:00100000:0.0:1782727826.638916:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00100000:0.0:1782727826.638932:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:2351:x1869325329787136:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727826.638967:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329786880 00000100:00100000:2.0:1782727826.638974:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329786880 00000100:00100000:2.0:1782727826.639032:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:2.0:1782727826.639042:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:2351:x1869325329786880:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727826.639075:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:2351:x1869325329787136:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 146us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727826.639084:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00100000:2.0:1782727826.639097:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:2351:x1869325329786880:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 55us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727826.639109:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00100000:0.0:1782727826.639116:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:2350:x1869325329787008:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727826.639131:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:0.0:1782727826.639146:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:2350:x1869325329787008:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727826.639154:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00100000:0.0:1782727826.639182:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329786752 00000100:00100000:0.0:1782727826.639186:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329786752 00000100:00080000:2.0:1782727826.639221:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727826.639222:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 247 00000100:00080000:2.0:1782727826.639229:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782727826.639235:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727826.639235:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329786752:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727826.639267:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2350:x1869325329786752:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 36us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727826.639274:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 247 00000100:00100000:2.0:1782727827.093217:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727827.093327:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329786624 00000100:00100000:1.0:1782727827.093349:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329786624 00002000:00100000:1.0:1782727827.093419:0:6944:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91fcec54fb80 x1869325329786624/t0(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:698/0 lens 4584/0 e 0 to 0 dl 1782727838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782727827.093449:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcec54fb80 with x1869325329786624 ext(0->4095) 00002000:00010000:1.0:1782727827.093456:0:6944:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcec54fb80 00000100:00100000:1.0:1782727827.093492:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:1.0:1782727827.093504:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:2353:x1869325329786624:12345-192.168.201.8@tcp:4:multiop.0 00000001:00020000:1.0:1782727827.093522:0:6944:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 sleeping for 1000ms 00000001:00020000:2.0:1782727827.329249:0:6944:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout interrupted 00000100:00100000:2.0:1782727827.339658:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:2353:x1869325329786624:12345-192.168.201.8@tcp:4:multiop.0 Request processed in 246140us (246444us total) trans 0 rc -30/-30 00000100:00100000:2.0:1782727827.339676:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00002000:00100000:2.0:1782727827.339694:0:6944:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91fcec54fb80 x1869325329786624/t0(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:698/0 lens 4584/224 e 0 to 0 dl 1782727838 ref 1 fl Complete:/600/0 rc -30/-30 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727827.339705:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcec54fb80 with x1869325329786624 ext(0->4095) 00002000:00010000:2.0:1782727827.339713:0:6944:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcec54fb80 00010000:00010000:1.0:1782727827.550177:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727828.572088:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782727828.961757:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1782727828.962476:0:8008:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1782727829.445142:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727829.447694:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329787264 00000100:00100000:1.0:1782727829.447714:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329787264 00002000:00100000:1.0:1782727829.447991:0:6943:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91fcfe486a00 x1869325329787264/t0(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:700/0 lens 4584/0 e 0 to 0 dl 1782727840 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782727829.448005:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe486a00 with x1869325329787264 ext(0->4095) 00002000:00010000:1.0:1782727829.448012:0:6943:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe486a00 00000100:00100000:1.0:1782727829.448070:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:1.0:1782727829.448081:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2353:x1869325329787264:12345-192.168.201.8@tcp:4:multiop.0 00000100:00100000:1.0:1782727829.452222:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:2353:x1869325329787264:12345-192.168.201.8@tcp:4:multiop.0 Request processed in 4115us (7069us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1782727829.452242:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00002000:00100000:1.0:1782727829.452261:0:6943:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91fcfe486a00 x1869325329787264/t4294967302(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:700/0 lens 4584/448 e 0 to 0 dl 1782727840 ref 1 fl Complete:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782727829.453226:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe486a00 with x1869325329787264 ext(0->4095) 00002000:00010000:1.0:1782727829.453236:0:6943:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe486a00 00000100:00080000:2.0:1782727829.454997:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727829.462575:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727829.462772:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329787392 00000100:00100000:1.0:1782727829.462798:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329787392 00000100:00100000:1.0:1782727829.463063:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00100000:1.0:1782727829.463078:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:11890:x1869325329787392:12345-192.168.201.8@tcp:44:multiop.0 00000100:00080000:2.0:1782727829.465288:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1782727829.465659:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967324 is committed 00000004:00080000:0.0:1782727829.465676:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:1.0:1782727829.466062:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:11890:x1869325329787392:12345-192.168.201.8@tcp:44:multiop.0 Request processed in 2979us (3494us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727829.466076:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 53 00000004:00080000:2.0:1782727829.466185:0:8368:0:(osp_sync.c:997:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 6 operation object 0x280000400:4 00000100:00100000:3.0:1782727829.466242:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727829.466264:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347646080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782727829.466397:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727829.466992:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347646080 00000100:00100000:1.0:1782727829.467002:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347646080 00000100:00100000:1.0:1782727829.467090:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727829.467103:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325347646080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782727829.467142:0:6938:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00010000:00010000:1.0:1782727829.467178:0:6938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727829.467206:0:6938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3ff2672/0xb393e873fab64776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c84 expref: 6 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727829.467238:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782727829.467244:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727829.467250:0:6938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782727829.467545:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782727829.467969:0:6938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3ff2672/0xb393e873fab64776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c84 expref: 6 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727829.467988:0:6938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3ff2672/0xb393e873fab64776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c84 expref: 6 pid: 6940 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727829.468007:0:6938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6938:1869325347646208:192.168.201.8@tcp:104: 00000100:00100000:1.0:1782727829.468157:0:6938:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf7d586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727829.473451:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727829.473550:0:6940:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727829.473564:0:6940:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1782727829.473922:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329787520 00000100:00100000:2.0:1782727829.473933:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329787520 00000100:00100000:0.0:1782727829.474154:0:12704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:0.0:1782727829.474166:0:12704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:2352:x1869325329787520:12345-192.168.201.8@tcp:16:multiop.0 00000001:00080000:1.0:1782727829.480683:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1782727829.480959:0:12704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2352:x1869325329787520:12345-192.168.201.8@tcp:16:multiop.0 Request processed in 6782us (7534us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727829.480975:0:12704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:1.0:1782727829.482165:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727829.482816:0:6938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6938:1869325347646208:192.168.201.8@tcp:104: 00010000:00010000:3.0:1782727829.482866:0:6938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727829.482930:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329787648 00000100:00100000:3.0:1782727829.482939:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329787648 00010000:00010000:3.0:1782727829.483014:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3ff2672/0xb393e873fab64776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c84 expref: 7 pid: 6940 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727829.483053:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:3.0:1782727829.483063:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2350:x1869325329787648:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782727829.483085:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727829.483090:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3ff2672/0xb393e873fab64776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c84 expref: 7 pid: 6940 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483105:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3ff2672/0xb393e873fab64776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c84 expref: 7 pid: 6940 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483141:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3ff2672/0xb393e873fab64776 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c84 expref: 7 pid: 6940 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483188:0:5937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727829.483194:0:5937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727829.483201:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483214:0:5937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483244:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727829.483336:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2350:x1869325329787648:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 273us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727829.483344:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 31 00010000:00010000:3.0:1782727829.483509:0:6938:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483519:0:6938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483530:0:6938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483538:0:6938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483557:0:6938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782727829.483814:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3443:x1869325347646080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16713us (17416us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782727829.483824:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1782727829.483849:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727829.483858:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483867:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567ae00 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:3.0:1782727829.483873:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483883:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483897:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483905:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000844ccff1/0xb393e873fab647fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.483927:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727829.483929:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727829.483931:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782727829.483974:0:3443:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91fcfe484e00/2, rc 0, transno 4294967302 00000100:00100000:3.0:1782727829.483983:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347646080:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1782727829.484329:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727829.491176:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727829.491869:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329787904 00000100:00100000:2.0:1782727829.491883:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329787904 00000100:00100000:2.0:1782727829.491961:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:2.0:1782727829.491976:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:11890:x1869325329787904:12345-192.168.201.8@tcp:35:multiop.0 00000001:00080000:2.0:1782727829.492314:0:5955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:2.0:1782727829.492514:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:11890:x1869325329787904:12345-192.168.201.8@tcp:35:multiop.0 Request processed in 541us (1353us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1782727829.492523:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000020:00080000:2.0:1782727829.492529:0:5955:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782727829.596121:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727829.654993:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727829.657123:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329788032 00000100:00100000:2.0:1782727829.657145:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329788032 00000100:00100000:2.0:1782727829.657271:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 54 00000100:00100000:2.0:1782727829.657293:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:11945:x1869325329788032:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:2.0:1782727829.657338:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727829.657382:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488cae expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.657566:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab64809 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.657585:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab64809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.657599:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab64809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727829.659042:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727829.659057:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727829.659108:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab64809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.659173:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cae expref: 11 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.659204:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab64809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cae expref: 10 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.659237:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42400) 00010000:00010000:2.0:1782727829.659241:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727829.659246:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a76a00, rc 0) 00000100:00100000:2.0:1782727829.659369:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:11945:x1869325329788032:12345-192.168.201.8@tcp:101:rm.0 Request processed in 2085us (4384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727829.659381:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 54 00000100:00100000:1.0:1782727829.672893:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727829.673025:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329788288 00000100:00100000:2.0:1782727829.673046:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329788288 00000100:00100000:2.0:1782727829.673173:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00100000:2.0:1782727829.673189:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:11945:x1869325329788288:12345-192.168.201.8@tcp:36:rm.0 00010000:00010000:2.0:1782727829.673281:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782727829.673334:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77c00/0xb393e873fab647e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca0 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.673369:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91fcd3c42c00) 00010000:00010000:2.0:1782727829.673389:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76a00/0xb393e873fab64809 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cae expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.673400:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42400) 00010000:00010000:2.0:1782727829.673406:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727829.673508:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64810 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.673525:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64810 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.673539:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64810 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.673577:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.673587:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.673595:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.675484:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab6481e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.675519:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab6481e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.675535:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab6481e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782727829.676056:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1782727829.676069:0:5951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336560645034ns, next at 337560641549ns, rc = 0 00010000:00010000:2.0:1782727829.676133:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676145:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676155:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676164:0:5951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676191:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676198:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676228:0:5951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782727829.676259:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab6481e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676266:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab6481e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676274:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab6481e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.676276:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727829.676282:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76800 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727829.676306:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab6481e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676327:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab6481e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.676328:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.676357:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76600 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:3.0:1782727829.676362:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.676372:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.676394:0:5939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91fcd3c42100) 00010000:00010000:3.0:1782727829.676397:0:5939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782727829.676402:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.676407:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76600/0xb393e873fab64825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.676505:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727829.676508:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727829.676510:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727829.676605:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91fcd3c42100) 00010000:00010000:2.0:1782727829.676610:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782727829.676615:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab6481e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676623:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76800/0xb393e873fab6481e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676652:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64810 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676893:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64810 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676900:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64810 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676906:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a76400 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:2.0:1782727829.676910:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64810 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676917:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64810 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676927:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd3c42000) 00010000:00010000:2.0:1782727829.676930:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727829.676933:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64810 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727829.676939:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a76400/0xb393e873fab64810 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727829.676955:0:5951:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002fd10914 reply state 00000000eeba26a6 transno 4294967327 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727829.676966:0:5951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727829.677102:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:11945:x1869325329788288:12345-192.168.201.8@tcp:36:rm.0 Request processed in 3912us (4218us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1782727829.677114:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 55 00010000:00010000:3.0:1782727829.684004:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.684034:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.684045:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.684053:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcf3a77a00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727829.684060:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.684092:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.684118:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11a4e1a9 (ffff91fcd3c42800) 00010000:00010000:3.0:1782727829.684122:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727829.684128:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727829.684135:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcf3a77a00/0xb393e873fab64817 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727829.979767:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727829.979809:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347646336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727829.979929:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727829.980003:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347646336 00000100:00100000:0.0:1782727829.980026:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347646336 00000100:00100000:0.0:1782727829.980101:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782727829.980111:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3442:x1869325347646336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727829.980144:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727829.980254:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3442:x1869325347646336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727829.980262:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782727829.982133:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347646336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727829.982821:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347646720:0@lo:400:kworker.0 00000100:00100000:3.0:1782727829.982910:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727829.982949:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727829.982954:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347646848:0@lo:400:kworker.0 00000100:00100000:3.0:1782727829.982984:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727829.983104:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347646848 00000100:00100000:3.0:1782727829.983112:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347646848 00000100:00100000:3.0:1782727829.983178:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782727829.983189:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347646848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727829.983537:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869325347646848:12345-0@lo:400:kworker.0 Request processed in 349us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727829.983546:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782727829.983594:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347646848:0@lo:400:kworker.0 00000100:00100000:1.0:1782727829.984367:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347646592:0@lo:400:kworker.0 00000100:00100000:1.0:1782727829.984535:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727829.984595:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347646720 00000100:00100000:1.0:1782727829.984596:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782727829.984605:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347646720 00000100:00100000:1.0:1782727829.984610:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347646464:0@lo:400:kworker.0 00000100:00100000:1.0:1782727829.984656:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727829.984675:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347646592 00000100:00100000:2.0:1782727829.984679:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347646592 00000100:00100000:2.0:1782727829.984712:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782727829.984721:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347646720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727829.984724:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347646976:0@lo:400:kworker.0 00000100:00100000:1.0:1782727829.984790:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727829.984819:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347646720:12345-0@lo:400:kworker.0 Request processed in 96us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727829.984831:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782727829.984837:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347646976 00000100:00100000:1.0:1782727829.984847:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347646976 00000100:00100000:2.0:1782727829.984856:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782727829.984871:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347646592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727829.984915:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325347646592:12345-0@lo:400:kworker.0 Request processed in 52us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727829.984924:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1782727829.984995:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347646464 00000100:00100000:0.0:1782727829.985001:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347646464 00000100:00100000:0.0:1782727829.985048:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1782727829.985058:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347646464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727829.985070:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347646720:0@lo:400:kworker.0 00000100:00100000:3.0:1782727829.985131:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3445:1869325347646464:0@lo:400:kworker.0 00000100:00100000:0.0:1782727829.985142:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3445:x1869325347646464:12345-0@lo:400:kworker.0 Request processed in 82us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727829.985159:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1782727829.985165:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325347646592:0@lo:400:kworker.0 00000100:00080000:3.0:1782727829.985207:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727829.985211:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727829.986170:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782727829.988515:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347646976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727829.988798:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325347646976:12345-0@lo:400:kworker.0 Request processed in 3861us (4006us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727829.988809:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782727829.988921:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325347646976:0@lo:400:kworker.0 00010000:00010000:2.0:1782727830.619985:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782727831.005471:0:7055:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337890045530ns, next at 338890042355ns, rc = 0 00000100:00100000:2.0:1782727831.006189:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347647104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727831.006267:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727831.006411:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347647104 00000100:00100000:3.0:1782727831.006420:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347647104 00000100:00080000:2.0:1782727831.006502:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727831.006505:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782727831.006516:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347647104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727831.006539:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 25408064 pending 0 free 3923537920 avail 3692015616 00000100:00100000:3.0:1782727831.006596:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347647104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727831.006603:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782727831.006629:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347647104:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782727831.647850:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727831.754357:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727831.754404:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727831.754483:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727831.754649:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329788672 00000100:00100000:1.0:1782727831.754661:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727831.754664:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329788672 00000100:00100000:2.0:1782727831.754730:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329788800 00000100:00100000:2.0:1782727831.754734:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329788800 00000100:00100000:2.0:1782727831.754755:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 58 00000100:00100000:2.0:1782727831.754764:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2351:x1869325329788672:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727831.754863:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2351:x1869325329788672:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 99us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727831.754872:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 58 00000100:00100000:2.0:1782727831.754889:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:2.0:1782727831.754895:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329788800:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1782727831.754920:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329788800:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727831.754926:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00080000:2.0:1782727831.754942:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727831.754946:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727831.755094:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329788544 00000100:00100000:3.0:1782727831.755099:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329788544 00000100:00100000:3.0:1782727831.755154:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:3.0:1782727831.755162:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:2351:x1869325329788544:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1782727831.755200:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:2351:x1869325329788544:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 40us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727831.755207:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:0.0:1782727831.755242:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329788416 00000100:00100000:0.0:1782727831.755248:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329788416 00000100:00100000:0.0:1782727831.755301:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 249 00000100:00100000:0.0:1782727831.755316:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329788416:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1782727831.755345:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329788416:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 30us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727831.755352:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 249 00000100:00080000:2.0:1782727831.756002:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727832.672311:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727833.691780:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727834.718149:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727835.099868:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347647616:0@lo:400:kworker.0 00000100:00100000:3.0:1782727835.099869:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347647232:0@lo:400:kworker.0 00000100:00100000:0.0:1782727835.100004:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347647488:0@lo:400:kworker.0 00000100:00100000:1.0:1782727835.100153:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347647360:0@lo:400:kworker.0 00000100:00100000:2.0:1782727835.107001:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727835.107113:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347647616 00000100:00100000:2.0:1782727835.107122:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347647616 00000100:00100000:2.0:1782727835.107180:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782727835.107193:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347647616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727835.107266:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347647616:12345-0@lo:400:kworker.0 Request processed in 76us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727835.107275:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1782727835.107299:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727835.107522:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347647616:0@lo:400:kworker.0 00000100:00100000:3.0:1782727835.109575:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727835.109645:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347647744:0@lo:400:kworker.0 00000100:00100000:3.0:1782727835.109705:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727835.109770:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347647744 00000100:00100000:3.0:1782727835.109778:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347647744 00000100:00100000:3.0:1782727835.110060:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1782727835.110073:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347647744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727835.110133:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325347647744:12345-0@lo:400:kworker.0 Request processed in 63us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727835.110142:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1782727835.110171:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727835.110216:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325347647744:0@lo:400:kworker.0 00000100:00100000:3.0:1782727835.110269:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347647232 00000100:00100000:3.0:1782727835.110273:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347647232 00000100:00100000:3.0:1782727835.110311:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1782727835.110320:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347647232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727835.110466:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3442:x1869325347647232:12345-0@lo:400:kworker.0 Request processed in 146us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727835.110474:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1782727835.110938:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3442:1869325347647232:0@lo:400:kworker.0 00000004:00080000:3.0:1782727835.111043:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:3.0:1782727835.111068:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967327 is committed 00000004:00080000:3.0:1782727835.111076:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1782727835.111119:0:7054:0:(osp_sync.c:997:osp_sync_new_err_job()) lustre-OST0000-osc-MDT0000 repeating 6 operation object 0x240000400:3 00000100:00100000:3.0:1782727835.111219:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347648128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782727835.111262:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727835.111297:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347648128 00000100:00100000:3.0:1782727835.111301:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347648128 00000100:00100000:3.0:1782727835.111527:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782727835.111537:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347648128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782727835.111570:0:6938:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1782727835.111601:0:6938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.111627:0:6938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4140af0/0xb393e873fab6476f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c7d expref: 6 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.111638:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=11s v=(0 0) 00010000:00010000:3.0:1782727835.111643:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727835.111648:0:6938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.111682:0:6938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4140af0/0xb393e873fab6476f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c7d expref: 6 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.111698:0:6938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4140af0/0xb393e873fab6476f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c7d expref: 6 pid: 6938 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727835.111711:0:6938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe635500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6938:1869325347648384:192.168.201.8@tcp:104: 00000100:00100000:3.0:1782727835.111788:0:6938:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fe0480 going to sleep for 11 seconds 00000100:00100000:3.0:1782727835.111999:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347648256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782727835.112028:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727835.112061:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347648256 00000100:00100000:3.0:1782727835.112065:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347648256 00000100:00100000:3.0:1782727835.112102:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782727835.112108:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3442:x1869325347648256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782727835.112122:0:6940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00010000:00010000:3.0:1782727835.112135:0:6940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.112148:0:6940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8587211/0xb393e873fab647f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca7 expref: 6 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.112154:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1782727835.112157:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727835.112161:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.112181:0:6940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8587211/0xb393e873fab647f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca7 expref: 6 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.112190:0:6940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8587211/0xb393e873fab647f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca7 expref: 6 pid: 6939 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727835.112201:0:6940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6940:1869325347648512:192.168.201.8@tcp:104: 00000100:00100000:3.0:1782727835.112248:0:6940:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcf9fe0840 going to sleep for 11 seconds 00000100:00100000:0.0:1782727835.122594:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727835.122648:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347647488 00000100:00100000:0.0:1782727835.122659:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347647488 00000100:00100000:0.0:1782727835.122736:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782727835.122746:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347647488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727835.122804:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325347647488:12345-0@lo:400:kworker.0 Request processed in 59us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727835.122811:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1782727835.122834:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727835.122874:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325347647488:0@lo:400:kworker.0 00000100:00100000:0.0:1782727835.122887:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347648000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727835.122921:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727835.122946:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347648000 00000100:00100000:0.0:1782727835.122951:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347648000 00000100:00100000:0.0:1782727835.122986:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782727835.122993:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869325347648000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727835.123033:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727835.123068:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869325347648000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727835.123074:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1782727835.123100:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727835.123125:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347648000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727835.123254:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727835.123290:0:6938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe635500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6938:1869325347648384:192.168.201.8@tcp:104: 00010000:00010000:0.0:1782727835.123313:0:6938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727835.123340:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329788928 00000100:00100000:0.0:1782727835.123343:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329788928 00010000:00010000:0.0:1782727835.123371:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4140af0/0xb393e873fab6476f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c7d expref: 7 pid: 6938 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727835.123482:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727835.123526:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347647360 00000100:00100000:1.0:1782727835.123530:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347647360 00000100:00100000:1.0:1782727835.123562:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782727835.123570:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcf3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347647360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727835.123607:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcf3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325347647360:12345-0@lo:400:kworker.0 Request processed in 38us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727835.123614:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782727835.123644:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325347647360:0@lo:400:kworker.0 00000100:00100000:1.0:1782727835.123652:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347647872:0@lo:400:kworker.0 00000100:00100000:1.0:1782727835.123708:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727835.123742:0:12704:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1782727835.123751:0:12704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1782727835.124275:0:12704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347647872 00000100:00100000:1.0:1782727835.124280:0:12704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347647872 00000100:00100000:1.0:1782727835.124308:0:12704:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1782727835.124318:0:12704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782727835.124325:0:12704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe6a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3443:x1869325347647872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727835.124590:0:12704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe6a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3443:x1869325347647872:12345-0@lo:400:kworker.0 Request processed in 264us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727835.124598:0:12704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782727835.124643:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869325347647872:0@lo:400:kworker.0 00000100:00080000:1.0:1782727835.124937:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727835.125240:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:0.0:1782727835.125257:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcde69b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2351:x1869325329788928:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727835.125271:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727835.125279:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000c4140af0/0xb393e873fab6476f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c7d expref: 7 pid: 6938 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727835.125295:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4140af0/0xb393e873fab6476f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c7d expref: 7 pid: 6938 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727835.125320:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4140af0/0xb393e873fab6476f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488c7d expref: 7 pid: 6938 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727835.125334:0:5938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1782727835.125345:0:5938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727835.125351:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727835.125361:0:5938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727835.125397:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727835.125464:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcde69b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2351:x1869325329788928:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 211us (2211us total) trans 0 rc 0/0 00010000:00010000:1.0:1782727835.125472:0:6938:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727835.125484:0:6938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727835.125495:0:6938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727835.125503:0:6938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727835.125599:0:6938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782727835.125944:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3445:x1869325347648128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14407us (14680us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1782727835.125953:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1782727835.127057:0:3445:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91fcfe635f80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1782727835.127088:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347648128:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782727835.127112:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727835.127121:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727835.127134:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346dc00 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:1.0:1782727835.127139:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727835.127151:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727835.127171:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727835.127179:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3ff2672/0xb393e873fab6482c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727835.127998:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727835.128004:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727835.128006:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782727835.131392:0:8008:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1782727835.134037:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727835.134090:0:5936:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782727835.134100:0:5936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1782727835.134443:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329789056 00000100:00100000:3.0:1782727835.134454:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329789056 00010000:00010000:3.0:1782727835.134504:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8587211/0xb393e873fab647f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca7 expref: 7 pid: 6939 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727835.134567:0:5936:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782727835.134578:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:3.0:1782727835.134591:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2350:x1869325329789056:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782727835.134612:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727835.134622:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000f8587211/0xb393e873fab647f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca7 expref: 7 pid: 6939 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.134642:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8587211/0xb393e873fab647f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca7 expref: 7 pid: 6939 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.134677:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1782727835.134684:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727835.134692:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.134704:0:5936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727835.134731:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727835.134803:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2350:x1869325329789056:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 214us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727835.134814:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 33 00010000:00010000:2.0:1782727835.137462:0:6940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8587211/0xb393e873fab647f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ca7 expref: 6 pid: 6939 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727835.137502:0:6940:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcec5d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6940:1869325347648512:192.168.201.8@tcp:104: 00010000:00010000:2.0:1782727835.137529:0:6940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727835.137539:0:6940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727835.137547:0:6940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727835.137558:0:6940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727835.137565:0:6940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727835.137587:0:6940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782727835.137769:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3442:x1869325347648256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25660us (25739us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1782727835.137778:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:2.0:1782727835.137824:0:3442:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91fcfe635c00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1782727835.137830:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347648256:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782727835.137846:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727835.137851:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727835.137865:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346d200 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:2.0:1782727835.137870:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727835.137878:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727835.137898:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727835.137904:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1aae3cd/0xb393e873fab64833 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727835.137920:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727835.137922:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727835.137923:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727835.139358:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 32 00010000:00010000:0.0:1782727835.741115:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727835.927785:0:12890:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 118d: Fsync validation inject a delay of the bulk ==================================================================== 06:10:34 (1782727834) 00000100:00100000:0.0:1782727836.123603:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727836.123629:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcd77f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347648640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727836.123700:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727836.123803:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347648640 00000100:00100000:2.0:1782727836.123811:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347648640 00000100:00100000:2.0:1782727836.123860:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782727836.123869:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1869325347648640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727836.123898:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 25408064 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727836.123944:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1869325347648640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727836.123951:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782727836.123997:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcd77f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347648640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727836.369831:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727836.370005:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329789184 00000100:00100000:0.0:1782727836.370014:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329789184 00000100:00100000:0.0:1782727836.370290:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00100000:0.0:1782727836.370301:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:12579:x1869325329789184:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1782727836.370321:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727836.370346:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab6483a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488cb5 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.370545:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab64841 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.370560:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab64841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.370586:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab64841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727836.370634:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727836.370637:0:5952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727836.370656:0:5952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab64841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.370682:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab6483a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cb5 expref: 8 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.370704:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab64841 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cb5 expref: 7 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.370713:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde65d00) 00010000:00010000:0.0:1782727836.370716:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727836.370719:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147e600, rc 0) 00000100:00100000:0.0:1782727836.370833:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:12579:x1869325329789184:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 533us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727836.370841:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00080000:1.0:1782727836.371030:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727836.378575:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727836.378701:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329789440 00000100:00100000:3.0:1782727836.378720:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329789440 00000100:00100000:3.0:1782727836.378800:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 57 00000100:00100000:3.0:1782727836.378827:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:12579:x1869325329789440:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1782727836.378851:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727836.378854:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782727836.378882:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab64841 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cb5 expref: 7 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.378903:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde65d00) 00010000:00010000:3.0:1782727836.378914:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727836.378928:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64848 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488cbc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379029:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6484f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379054:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6484f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379064:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6484f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379077:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379084:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379091:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379597:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379615:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379622:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727836.379632:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:3.0:1782727836.379659:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6484f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379666:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6484f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379673:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6484f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379679:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346de00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727836.379685:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6484f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379692:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6484f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379701:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3700) 00010000:00010000:3.0:1782727836.379704:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727836.379707:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6484f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379714:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab6484f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727836.379725:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e34220b reply state 00000000b22c4535 transno 4294967328 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727836.379740:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782727836.379766:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab64848 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cbc expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379784:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cbc expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.379791:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcd0ad3e00) 00010000:00010000:3.0:1782727836.379794:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727836.379796:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346d200, rc 0) 00000100:00100000:3.0:1782727836.379873:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:12579:x1869325329789440:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1050us (1307us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1782727836.379881:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 57 00000100:00100000:2.0:1782727836.385191:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727836.385273:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329789696 00000100:00100000:0.0:1782727836.385286:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329789696 00000100:00100000:0.0:1782727836.385364:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 58 00000100:00100000:0.0:1782727836.385375:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:12579:x1869325329789696:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1782727836.385403:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727836.385463:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab6486b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488cc3 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.385603:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.385621:0:5952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cbc expref: 10 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.385631:0:5952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.385682:0:5952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cbc expref: 10 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.385696:0:5952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cbc expref: 10 pid: 5953 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727836.385711:0:5952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe463100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5952:1869325347648768:192.168.201.8@tcp:104: 00000100:00100000:0.0:1782727836.385829:0:5952:0:(client.c:2701:ptlrpc_set_wait()) set ffff91fcfe4e1540 going to sleep for 11 seconds 00010000:00010000:3.0:1782727836.385942:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.385950:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.385957:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.385963:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346cc00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727836.385968:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.385977:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.386003:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff91fcd0ad3d00) 00010000:00010000:3.0:1782727836.386006:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727836.386010:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.386017:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64856 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727836.389341:0:5952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe463100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5952:1869325347648768:192.168.201.8@tcp:104: 00010000:00010000:0.0:1782727836.389372:0:5952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727836.392070:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727836.392295:0:12854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329789824 00000100:00100000:1.0:1782727836.392305:0:12854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329789824 00010000:00010000:1.0:1782727836.392344:0:12854:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cbc expref: 10 pid: 5953 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727836.392466:0:12854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 34 00000100:00100000:1.0:1782727836.392477:0:12854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:2351:x1869325329789824:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782727836.392491:0:12854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727836.392498:0:12854:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cbc expref: 10 pid: 5953 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.392511:0:12854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cbc expref: 10 pid: 5953 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.392537:0:12854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab6485d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cbc expref: 10 pid: 5953 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.392555:0:12854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcd0ad3e00) 00010000:00010000:1.0:1782727836.392560:0:12854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.392571:0:12854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.392577:0:12854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.392597:0:12854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727836.392652:0:12854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:2351:x1869325329789824:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 177us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727836.392660:0:12854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 34 00010000:00010000:0.0:1782727836.393089:0:5952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.393099:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727836.393117:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00000004:00080000:0.0:1782727836.393325:0:5952:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00000004:00080000:0.0:1782727836.393332:0:5952:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1782727836.393455:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.393463:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.393471:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.393477:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc147ea00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:0.0:1782727836.393481:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.393489:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.393498:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcd0ad3e00) 00010000:00010000:0.0:1782727836.393501:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782727836.393504:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.393510:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab64872 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.393560:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab6486b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cc3 expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.393568:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde65300) 00010000:00010000:0.0:1782727836.393570:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782727836.393579:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab6486b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cc3 expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.393592:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147e200, rc 0) 00000100:00100000:0.0:1782727836.393623:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:12579:x1869325329789696:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 8251us (8457us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1782727836.393630:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 58 00000100:00100000:2.0:1782727836.398567:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727836.398687:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329790080 00000100:00100000:0.0:1782727836.398698:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329790080 00000100:00100000:0.0:1782727836.398747:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:0.0:1782727836.398757:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:12579:x1869325329790080:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1782727836.399288:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:12579:x1869325329790080:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 530us (731us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1782727836.399297:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:2.0:1782727836.403794:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727836.403948:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329790208 00000100:00100000:1.0:1782727836.403972:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329790208 00000100:00100000:1.0:1782727836.404252:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:1.0:1782727836.404265:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:12579:x1869325329790208:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1782727836.404288:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727836.404310:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab64880 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488cca expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.404365:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab64880 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cca expref: 10 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.404380:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab64880 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cca expref: 10 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.404397:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcc3a5b900) 00010000:00010000:1.0:1782727836.404400:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782727836.404403:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567ae00, rc 0) 00000100:00100000:1.0:1782727836.404478:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:12579:x1869325329790208:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 216us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727836.404485:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:2.0:1782727836.409236:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727836.409334:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329790464 00000100:00100000:0.0:1782727836.409344:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329790464 00000100:00100000:0.0:1782727836.409468:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:0.0:1782727836.409478:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:12579:x1869325329790464:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1782727836.409699:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+11:12579:x1869325329790464:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 222us (474us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1782727836.409706:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:2.0:1782727836.422485:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727836.422718:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329790592 00000100:00100000:1.0:1782727836.422730:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329790592 00000100:00100000:1.0:1782727836.422801:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:1.0:1782727836.422813:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcd77f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+11:12580:x1869325329790592:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:1.0:1782727836.422848:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727836.422884:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab64887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488cd1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.422977:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab6488e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.423003:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab6488e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.423017:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab6488e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727836.423074:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727836.423078:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727836.423101:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab6488e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.423345:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab64887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cd1 expref: 13 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.423363:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab6488e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cd1 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.423371:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc3a5b100) 00010000:00010000:1.0:1782727836.423374:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727836.423377:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567a200, rc 0) 00000100:00100000:1.0:1782727836.423523:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcd77f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+12:12580:x1869325329790592:12345-192.168.201.8@tcp:101:dd.0 Request processed in 713us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727836.423531:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:2.0:1782727836.429975:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727836.430057:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329790848 00000100:00100000:3.0:1782727836.430069:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329790848 00000100:00100000:3.0:1782727836.430176:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 61 00000100:00100000:3.0:1782727836.430197:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+12:12580:x1869325329790848:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:3.0:1782727836.430224:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727836.430228:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782727836.430264:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a200/0xb393e873fab6488e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cd1 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430287:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc3a5b100) 00010000:00010000:3.0:1782727836.430300:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727836.430318:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64895 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488cd8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430473:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6489c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430487:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6489c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430497:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6489c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430521:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab648a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430529:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab648a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430536:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab648a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430602:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab648aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430610:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab648aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430616:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab648aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727836.430628:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:3.0:1782727836.430726:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6489c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430732:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6489c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430740:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6489c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430747:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346dc00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727836.430752:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6489c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430770:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6489c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430779:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3d00) 00010000:00010000:3.0:1782727836.430782:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727836.430786:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6489c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430792:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6489c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430801:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab648a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430808:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab648a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430814:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab648a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430819:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346c800 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727836.430822:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab648a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430828:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab648a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430834:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff91fcd0ad3700) 00010000:00010000:3.0:1782727836.430837:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727836.430839:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab648a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430854:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab648a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430894:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64895 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cd8 expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430908:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab648aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cd8 expref: 13 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.430925:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcc3a5b900) 00010000:00010000:3.0:1782727836.430927:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727836.430930:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346de00, rc 0) 00000100:00100000:3.0:1782727836.430998:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+13:12580:x1869325329790848:12345-192.168.201.8@tcp:101:dd.0 Request processed in 812us (1098us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1782727836.431006:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 61 00000100:00100000:2.0:1782727836.436044:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727836.436322:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329790976 00000100:00100000:0.0:1782727836.436337:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329790976 00000100:00100000:0.0:1782727836.436639:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 62 00000100:00100000:0.0:1782727836.436651:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+13:12580:x1869325329790976:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:0.0:1782727836.436688:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727836.436729:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab648b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488cdf expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.436775:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab648bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.436791:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab648bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.436804:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab648bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.436954:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab648b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cdf expref: 15 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.436976:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab648bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cdf expref: 14 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.436985:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcc3a5b900) 00010000:00010000:0.0:1782727836.436988:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782727836.436991:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147ea00, rc 0) 00000100:00100000:0.0:1782727836.437096:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+14:12580:x1869325329790976:12345-192.168.201.8@tcp:101:dd.0 Request processed in 447us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727836.437104:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 62 00000100:00100000:3.0:1782727836.442403:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727836.442503:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329791232 00000100:00100000:1.0:1782727836.442513:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329791232 00000100:00100000:1.0:1782727836.442579:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:1.0:1782727836.442591:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcec5d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+14:12580:x1869325329791232:12345-192.168.201.8@tcp:36:dd.0 00010000:00010000:1.0:1782727836.442675:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727836.442720:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346de00/0xb393e873fab648aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cd8 expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.442742:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcc3a5b900) 00010000:00010000:1.0:1782727836.442747:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727836.442958:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.442972:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.442981:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782727836.443031:0:8231:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967333 00000004:00010000:1.0:1782727836.443053:0:8231:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000043412c11 reply state 000000009ef11221 transno 4294967334 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727836.443063:0:8231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782727836.443643:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcec5d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:12580:x1869325329791232:12345-192.168.201.8@tcp:36:dd.0 Request processed in 1049us (1251us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1782727836.443654:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 63 00000020:00080000:1.0:1782727836.443671:0:8231:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782727836.448324:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.448343:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.448350:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.448375:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc567aa00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727836.448382:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.448390:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.448412:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcc3a5b900) 00010000:00010000:1.0:1782727836.448415:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727836.448419:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.448442:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727836.448653:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727836.448756:0:12704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329791360 00000100:00100000:1.0:1782727836.448765:0:12704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329791360 00000100:00100000:1.0:1782727836.448820:0:12704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:1.0:1782727836.448829:0:12704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+5:12580:x1869325329791360:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:1.0:1782727836.448850:0:12704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727836.448871:0:12704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3d3df44/0xb393e873fab648cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488ce6 expref: -99 pid: 12704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782727836.448897:0:12704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782727836.448931:0:12704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1782727836.448935:0:12704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727836.448945:0:12704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d3df44/0xb393e873fab648cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ce6 expref: 6 pid: 12704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.448977:0:12704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3d3df44/0xb393e873fab648cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ce6 expref: 6 pid: 12704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.448990:0:12704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567b600, rc 0) 00000100:00100000:1.0:1782727836.449057:0:12704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:12580:x1869325329791360:12345-192.168.201.8@tcp:101:dd.0 Request processed in 229us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727836.449064:0:12704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:2.0:1782727836.453109:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727836.453378:0:12853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329791488 00000100:00100000:1.0:1782727836.453388:0:12853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329791488 00000100:00100000:1.0:1782727836.453581:0:12853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00100000:1.0:1782727836.453591:0:12853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:12580:x1869325329791488:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:1.0:1782727836.453617:0:12853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727836.453646:0:12853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009db655a8/0xb393e873fab648d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488ced expref: -99 pid: 12853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782727836.453692:0:12853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782727836.453719:0:12853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1782727836.453725:0:12853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727836.453733:0:12853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db655a8/0xb393e873fab648d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ced expref: 7 pid: 12853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.453754:0:12853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009db655a8/0xb393e873fab648d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488ced expref: 7 pid: 12853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.453784:0:12853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567a200, rc 0) 00000100:00100000:1.0:1782727836.453855:0:12853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:12580:x1869325329791488:12345-192.168.201.8@tcp:101:dd.0 Request processed in 265us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727836.453863:0:12853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00080000:0.0:1782727836.457417:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727836.458374:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727836.458419:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727836.458545:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329791616 00000100:00100000:1.0:1782727836.458558:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329791616 00002000:00010000:1.0:1782727836.458600:0:6943:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1782727836.458607:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe463100 with x1869325329791616 ext(0->18446744073709551615) 00002000:00010000:1.0:1782727836.458622:0:6943:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe463100. 00000100:00100000:1.0:1782727836.458651:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329791744 00000100:00100000:1.0:1782727836.458654:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329791744 00002000:00010000:1.0:1782727836.458673:0:6943:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1782727836.458676:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe462a00 with x1869325329791744 ext(0->18446744073709551615) 00002000:00010000:1.0:1782727836.458682:0:6943:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91fcfe462a00. 00000100:00100000:1.0:1782727836.458695:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:1.0:1782727836.458705:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+6:2353:x1869325329791616:12345-192.168.201.8@tcp:10:dd.0 00002000:00010000:1.0:1782727836.458909:0:6943:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782727836.458913:0:6943:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782727836 00002000:00010000:1.0:1782727836.458926:0:6943:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782727836.458928:0:6943:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782727836 00002000:00010000:1.0:1782727836.458930:0:6943:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1782727836.459000:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2353:x1869325329791616:12345-192.168.201.8@tcp:10:dd.0 Request processed in 296us (637us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1782727836.459008:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00002000:00010000:1.0:1782727836.459028:0:6943:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1782727836.459031:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe463100 with x1869325329791616 ext(0->18446744073709551615) 00002000:00010000:1.0:1782727836.459036:0:6943:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe463100. 00000100:00100000:1.0:1782727836.459056:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:1.0:1782727836.459062:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2353:x1869325329791744:12345-192.168.201.8@tcp:10:dd.0 00002000:00010000:1.0:1782727836.459151:0:6943:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782727836.459153:0:6943:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782727836 00002000:00010000:1.0:1782727836.459155:0:6943:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782727836.459157:0:6943:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782727836 00002000:00010000:1.0:1782727836.459158:0:6943:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1782727836.459180:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+8:2353:x1869325329791744:12345-192.168.201.8@tcp:10:dd.0 Request processed in 118us (760us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1782727836.459199:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00002000:00010000:1.0:1782727836.459203:0:6943:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1782727836.459205:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe462a00 with x1869325329791744 ext(0->18446744073709551615) 00002000:00010000:1.0:1782727836.459208:0:6943:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91fcfe462a00. 00000100:00100000:3.0:1782727836.476413:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727836.476569:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329792000 00000100:00100000:2.0:1782727836.476580:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329792000 00000100:00100000:2.0:1782727836.476638:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1782727836.476647:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+15:12580:x1869325329792000:12345-192.168.201.8@tcp:35:dd.0 00000100:00100000:2.0:1782727836.476994:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:12580:x1869325329792000:12345-192.168.201.8@tcp:35:dd.0 Request processed in 347us (589us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1782727836.477002:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:0.0:1782727836.493140:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727836.493278:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329792128 00000100:00100000:1.0:1782727836.493289:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329792128 00002000:00100000:1.0:1782727836.493339:0:6943:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->131071) req@ffff91fcfe461f80 x1869325329792128/t0(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:707/0 lens 488/0 e 0 to 0 dl 1782727847 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782727836.493350:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe461f80 with x1869325329792128 ext(0->131071) 00002000:00010000:1.0:1782727836.493356:0:6943:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe461f80 00000100:00100000:1.0:1782727836.493392:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:1.0:1782727836.493400:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+7:2350:x1869325329792128:12345-192.168.201.8@tcp:4:dd.0 00000100:00100000:1.0:1782727836.500033:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:2350:x1869325329792128:12345-192.168.201.8@tcp:4:dd.0 Request processed in 6622us (6903us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782727836.500062:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00002000:00100000:1.0:1782727836.500076:0:6943:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->131071) req@ffff91fcfe461f80 x1869325329792128/t4294967306(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:707/0 lens 488/448 e 0 to 0 dl 1782727847 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782727836.500087:0:6943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe461f80 with x1869325329792128 ext(0->131071) 00002000:00010000:1.0:1782727836.500094:0:6943:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe461f80 00000100:00100000:3.0:1782727836.511555:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727836.511731:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329792256 00000100:00100000:1.0:1782727836.511741:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329792256 00000100:00100000:1.0:1782727836.511829:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 64 00000100:00100000:1.0:1782727836.511840:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:12582:x1869325329792256:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:1.0:1782727836.511864:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727836.511886:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab648db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488cf4 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.511958:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.511971:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.511982:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727836.512025:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727836.512029:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727836.512049:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.512072:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab648db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cf4 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.512105:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cf4 expref: 17 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727836.512113:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc3a5b200) 00010000:00010000:1.0:1782727836.512116:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727836.512119:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567aa00, rc 0) 00000100:00100000:1.0:1782727836.512192:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bd37c29-d4cd-43a2-9946-117a0c108d30+17:12582:x1869325329792256:12345-192.168.201.8@tcp:101:rm.0 Request processed in 344us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727836.512200:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 64 00000100:00100000:3.0:1782727836.516347:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727836.516820:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329792384 00000100:00100000:0.0:1782727836.516831:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329792384 00000100:00100000:0.0:1782727836.516902:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 65 00000100:00100000:0.0:1782727836.516920:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+17:12582:x1869325329792384:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:0.0:1782727836.516950:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727836.516976:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab648e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488cfb expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517046:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab648f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517062:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab648f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517075:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab648f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517093:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab648f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517100:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab648f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517105:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab648f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517320:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147f000/0xb393e873fab648fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517330:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147f000/0xb393e873fab648fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517337:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147f000/0xb393e873fab648fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727836.517398:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 131072 00000004:00200000:0.0:1782727836.517403:0:5952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727836.517451:0:5952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147f000/0xb393e873fab648fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517464:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147f000/0xb393e873fab648fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517472:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab648f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517478:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab648f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517485:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab648f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517491:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc147ec00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:0.0:1782727836.517495:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab648f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517502:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab648f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517513:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc3a5b200) 00010000:00010000:0.0:1782727836.517516:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727836.517520:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab648f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517526:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ec00/0xb393e873fab648f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517552:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab648f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517558:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab648f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517564:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab648f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517569:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc147e600 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:0.0:1782727836.517572:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab648f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517577:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab648f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517585:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff91fcfde65300) 00010000:00010000:0.0:1782727836.517587:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727836.517590:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab648f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517595:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e600/0xb393e873fab648f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517632:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147e200/0xb393e873fab648e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cfb expref: 19 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517645:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147f000/0xb393e873fab648fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cfb expref: 18 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.517739:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcc3a5b900) 00010000:00010000:0.0:1782727836.517742:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727836.517745:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc147f000, rc 0) 00000100:00100000:0.0:1782727836.517813:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+18:12582:x1869325329792384:12345-192.168.201.8@tcp:101:rm.0 Request processed in 902us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727836.517820:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 65 00000100:00100000:3.0:1782727836.530066:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727836.530168:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329792640 00000100:00100000:0.0:1782727836.530189:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329792640 00000100:00100000:0.0:1782727836.530263:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 66 00000100:00100000:0.0:1782727836.530275:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+18:12582:x1869325329792640:12345-192.168.201.8@tcp:36:rm.0 00010000:00010000:0.0:1782727836.530342:0:5952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1782727836.530375:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147f000/0xb393e873fab648fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cfb expref: 18 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530401:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147ea00/0xb393e873fab648bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cdf expref: 17 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530414:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567ae00/0xb393e873fab64880 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cca expref: 16 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530467:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcc3a5b900) 00010000:00010000:0.0:1782727836.530486:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab648e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488cf4 expref: 15 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530494:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc3a5b200) 00010000:00010000:0.0:1782727836.530512:0:5952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727836.530535:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab64905 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530548:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab64905 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530558:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab64905 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530571:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530577:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530584:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530706:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cda00/0xb393e873fab64913 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530715:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cda00/0xb393e873fab64913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.530721:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cda00/0xb393e873fab64913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782727836.530997:0:5952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1782727836.531010:0:5952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343415584997ns, next at 344415582062ns, rc = 0 00000040:00080000:0.0:1782727836.531033:0:5952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1782727836.531039:0:5952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343415614909ns, next at 344415613658ns, rc = 0 00010000:00010000:0.0:1782727836.531088:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531103:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531111:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531119:0:5952:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531125:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531131:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531162:0:5952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727836.531192:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cda00/0xb393e873fab64913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531198:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cda00/0xb393e873fab64913 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531204:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cda00/0xb393e873fab64913 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531210:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcfe5cda00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:0.0:1782727836.531215:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cda00/0xb393e873fab64913 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531222:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cda00/0xb393e873fab64913 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531241:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcfde65f00) 00010000:00010000:0.0:1782727836.531244:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782727836.531247:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cda00/0xb393e873fab64913 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531260:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cda00/0xb393e873fab64913 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531280:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab64905 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531286:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab64905 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531291:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab64905 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531296:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc147fc00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:0.0:1782727836.531298:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab64905 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531304:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab64905 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531316:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcfde65500) 00010000:00010000:0.0:1782727836.531319:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727836.531322:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab64905 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.531328:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fc00/0xb393e873fab64905 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727836.531354:0:5952:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001cd4a56e reply state 00000000daadad04 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727836.531363:0:5952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727836.531477:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:12582:x1869325329792640:12345-192.168.201.8@tcp:36:rm.0 Request processed in 1203us (1422us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1782727836.531486:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 66 00010000:00010000:3.0:1782727836.531635:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727836.531641:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.531648:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcfe5cc600 already unused, calling callback (ffffffffc0c1dcf0) 00010000:00010000:3.0:1782727836.531650:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.531675:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.531685:0:5940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff91fcfde65f00) 00010000:00010000:3.0:1782727836.531687:0:5940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782727836.531690:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.531695:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcfe5cc600/0xb393e873fab6491a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.531709:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727836.531710:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727836.531712:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727836.536523:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.536546:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.536554:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.536561:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcc147fe00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727836.536567:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.536576:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.536595:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff91fcfde65800) 00010000:00010000:3.0:1782727836.536624:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727836.536630:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727836.536636:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc147fe00/0xb393e873fab6490c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727836.765134:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727836.863822:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727836.863943:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329792768 00000100:00100000:1.0:1782727836.863954:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329792768 00000100:00100000:1.0:1782727836.864004:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 251 00000100:00100000:1.0:1782727836.864013:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329792768:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1782727836.864086:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3a2b312-3952-4d62-a958-96e4c68c622a+10:2351:x1869325329792768:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727836.864093:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 251 00000100:00100000:0.0:1782727837.377219:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1782727837.377279:0:8231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329792896 00000100:00100000:1.0:1782727837.377287:0:8231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329792896 00000100:00100000:1.0:1782727837.377336:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 67 00000100:00100000:1.0:1782727837.377344:0:8231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+15:12624:x1869325329792896:12345-192.168.201.8@tcp:101:multiop.0 00010000:00010000:1.0:1782727837.377366:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727837.377385:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488d02 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.377460:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab64928 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.377482:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab64928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.377496:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab64928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727837.377536:0:8231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727837.377540:0:8231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727837.377560:0:8231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab64928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.377583:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567a800/0xb393e873fab64921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488d02 expref: 17 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.377599:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab64928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488d02 expref: 16 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.377607:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc3a5b000) 00010000:00010000:1.0:1782727837.377610:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727837.377613:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcc567aa00, rc 0) 00000100:00100000:1.0:1782727837.377665:0:8231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:12624:x1869325329792896:12345-192.168.201.8@tcp:101:multiop.0 Request processed in 320us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727837.377671:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 67 00000100:00100000:0.0:1782727837.388575:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1782727837.388644:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329793152 00000100:00100000:3.0:1782727837.388654:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329793152 00000100:00100000:3.0:1782727837.388713:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 68 00000100:00100000:3.0:1782727837.388724:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+16:12624:x1869325329793152:12345-192.168.201.8@tcp:101:multiop.0 00010000:00010000:3.0:1782727837.388746:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727837.388749:0:5952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782727837.388775:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcc567aa00/0xb393e873fab64928 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488d02 expref: 16 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.388794:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcc3a5b000) 00010000:00010000:3.0:1782727837.388805:0:5952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727837.388822:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6492f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488d09 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.388950:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64936 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.388963:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64936 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.388972:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64936 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.388997:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389004:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389011:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782727837.389336:0:5952:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1782727837.389497:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab64944 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389506:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab64944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389514:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab64944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389547:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64936 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389555:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64936 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389562:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64936 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389568:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346cc00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:3.0:1782727837.389572:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64936 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389589:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64936 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389598:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91fcd0ad3d00) 00010000:00010000:3.0:1782727837.389601:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727837.389604:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64936 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389610:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346cc00/0xb393e873fab64936 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727837.389621:0:5952:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e7f6c24 reply state 0000000026d08bb9 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727837.389631:0:5952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782727837.389657:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346c800/0xb393e873fab6492f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488d09 expref: 18 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389676:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346d200/0xb393e873fab64944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488d09 expref: 17 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727837.389683:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91fcd0ad3c00) 00010000:00010000:3.0:1782727837.389685:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727837.389687:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcd346d200, rc 0) 00000100:00100000:3.0:1782727837.389754:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bd37c29-d4cd-43a2-9946-117a0c108d30+18:12624:x1869325329793152:12345-192.168.201.8@tcp:101:multiop.0 Request processed in 1032us (1187us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1782727837.389763:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 68 00010000:00010000:1.0:1782727837.395279:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.395298:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.395321:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.395328:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91fcd346dc00 already unused, calling callback (ffffffffc18264f0) 00010000:00010000:1.0:1782727837.395333:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.395341:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.395358:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e182d30 (ffff91fcd0ad3700) 00010000:00010000:1.0:1782727837.395362:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727837.395366:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727837.395373:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91fcd346dc00/0xb393e873fab6493d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727837.398687:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1782727837.398785:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329793280 00000100:00100000:2.0:1782727837.398795:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329793280 00000100:00100000:2.0:1782727837.398868:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:2.0:1782727837.398879:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+9:12624:x1869325329793280:12345-192.168.201.8@tcp:101:multiop.0 00010000:00010000:2.0:1782727837.398913:0:6940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727837.398939:0:6940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021e67f59/0xb393e873fab64952 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e2bb4be65488d10 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782727837.398968:0:6940:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782727837.398994:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1782727837.399009:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782727837.399021:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021e67f59/0xb393e873fab64952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488d10 expref: 10 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727837.399041:0:6940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021e67f59/0xb393e873fab64952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3e2bb4be65488d10 expref: 10 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727837.399054:0:6940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91fcf3a77e00, rc 0) 00000100:00100000:2.0:1782727837.399108:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:12624:x1869325329793280:12345-192.168.201.8@tcp:101:multiop.0 Request processed in 231us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727837.399115:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00080000:1.0:1782727837.399480:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727837.404275:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1782727837.404366:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325329793408 00000100:00100000:0.0:1782727837.404377:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325329793408 00002000:00100000:0.0:1782727837.404457:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91fcfe610000 x1869325329793408/t0(0) o4->7bd37c29-d4cd-43a2-9946-117a0c108d30@192.168.201.8@tcp:708/0 lens 4584/0 e 0 to 0 dl 1782727848 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782727837.404468:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91fcfe610000 with x1869325329793408 ext(0->4095) 00002000:00010000:0.0:1782727837.404473:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91fcfe610000 00000100:00100000:0.0:1782727837.404505:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:0.0:1782727837.404516:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bd37c29-d4cd-43a2-9946-117a0c108d30+10:2351:x1869325329793408:12345-192.168.201.8@tcp:4:multiop.0 00000001:00020000:0.0:1782727837.404528:0:6945:0:(tgt_handler.c:2784:tgt_brw_write()) cfs_fail_timeout id 214 sleeping for 5000ms 00010000:00010000:2.0:1782727837.787847:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727838.811802:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727839.836179:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727839.916812:0:12987:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_118d: @@@@@@ FAIL: No page in writeback, writeback=0 00000004:00080000:0.0:1782727840.219676:0:8369:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347104249363ns, next at 348104245890ns, rc = 0 00000100:00100000:1.0:1782727840.220049:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727840.220072:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347648896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727840.220187:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727840.220314:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347648896 00000100:00100000:0.0:1782727840.220323:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347648896 00000100:00100000:0.0:1782727840.220390:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782727840.220401:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347648896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727840.220472:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727840.220549:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325347648896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727840.220557:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782727840.220601:0:3445:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1782727840.220607:0:3445:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91fcfe484e00, transno 4294967302 00000100:00100000:0.0:1782727840.220625:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869325347648896:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782727840.220832:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727840.228272:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347649408:0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.228350:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727840.228454:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782727840.228463:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347649024:0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.228498:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727840.228532:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347649536:0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.228560:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727840.228585:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347649152:0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.228625:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727840.228839:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727840.228847:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347649280:0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.228872:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727840.228907:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347649536 00000100:00100000:2.0:1782727840.228930:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347649536 00000100:00100000:2.0:1782727840.228986:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347649152 00000100:00100000:2.0:1782727840.228989:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347649152 00000100:00100000:2.0:1782727840.229004:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347649280 00000100:00100000:2.0:1782727840.229006:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347649280 00000100:00100000:2.0:1782727840.229026:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782727840.229035:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347649536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.229091:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325347649536:12345-0@lo:400:kworker.0 Request processed in 57us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727840.229099:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782727840.229126:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1782727840.229134:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347649152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.229165:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325347649152:12345-0@lo:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727840.229170:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1782727840.229182:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782727840.229187:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347649280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.229212:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325347649280:12345-0@lo:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727840.229218:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782727840.229263:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325347649280:0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.229275:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325347649152:0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.229308:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325347649536:0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.229341:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347649024 00000100:00100000:2.0:1782727840.229345:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347649024 00000100:00100000:2.0:1782727840.229369:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1782727840.229382:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcc55fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347649024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727840.229420:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcc55fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73+19:3444:x1869325347649024:12345-0@lo:400:kworker.0 Request processed in 38us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727840.229555:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1782727840.229590:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cd8b12a-6d7e-47f1-8c4f-1140ea07eb73:3444:1869325347649024:0@lo:400:kworker.0 00000100:00100000:0.0:1782727840.229876:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347649408 00000100:00100000:0.0:1782727840.229881:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347649408 00000100:00100000:0.0:1782727840.229912:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782727840.229919:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3444:x1869325347649408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727840.229962:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3444:x1869325347649408:12345-0@lo:400:kworker.0 Request processed in 43us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727840.229969:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1782727840.230372:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727840.230378:0:5947:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727840.230914:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869325347649408:0@lo:400:kworker.0 00010000:00010000:0.0:1782727840.859660:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727841.243693:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91fcfe4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347649664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727841.243768:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1782727841.243947:0:7055:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348128522448ns, next at 349128520338ns, rc = 0 00000100:00100000:0.0:1782727841.244038:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325347649664 00000100:00100000:0.0:1782727841.244047:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325347649664 00000100:00100000:0.0:1782727841.244111:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782727841.244121:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91fcfe610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1869325347649664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727841.244150:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33845824 pending 155648 free 3923537920 avail 3692015616 00000100:00100000:0.0:1782727841.244291:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91fcfe610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1869325347649664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727841.244299:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000001:00080000:0.0:1782727841.246048:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1782727841.246065:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:3.0:1782727841.246230:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91fcfe4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869325347649664:0@lo:13:osp-pre-0-0.0 Debug log: 11889 lines, 11889 kept, 0 dropped, 0 bad.