00000001:02000400:1.0F:1782727137.608627:0:3095:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_hostid 00000001:02000400:1.0:1782727154.987196:0:3320:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1782727156.863277:0:3383:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 791 MB/s 00000001:01000000:0.0F:1782727157.116405:0:3383:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 577 MB/s 00000001:01000000:1.0:1782727157.372055:0:3383:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4242 MB/s 00000020:02000000:0.0:1782727158.109482:0:3412:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_gbddb8b7 00000400:02000000:2.0:1782727158.980455:0:3428:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.123@tcp [8/256/0/180] 00008000:02000000:2.0:1782727163.101676:0:3577:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1782727212.013839:0:5179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782727229.044603:0:5928:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782727229.044610:0:5928:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1782727229.044612:0:5928:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1782727229.044767:0:5928:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000fc6d3e95 00000080:02000400:2.0:1782727229.044777:0:5928:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1782727229.049913:0:5928:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1782727229.049925:0:5928:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782727229.049973:0:5928:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000f6b5207) 00000020:00000080:2.0:1782727229.049992:0:5928:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1782727229.120506:0:5928:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1782727229.120636:0:5928:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1782727229.163540:0:5928:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1782727229.163846:0:5928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1782727229.163856:0:5928:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782727229.163877:0:5928:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9832bf6cd8a42b0f 00000020:01000004:0.0:1782727229.163886:0:5928:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1782727229.163892:0:5928:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1782727229.163897:0:5928:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fc6d3e95 from MGS 00000020:01000004:0.0:1782727229.163904:0:5928:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1782727229.164142:0:5928:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000010e87f7f) 00000020:00000080:0.0:1782727229.164231:0:5928:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1782727229.164425:0:5928:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fc6d3e95 from MGS, refs=2 00080000:01000000:0.0:1782727229.164431:0:5928:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782727229.164436:0:5928:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9832bf6cd8a42b1d 00000100:00100000:0.0:1782727229.164552:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1782727229.164688:0:5928:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1782727229.164695:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1782727229.169096:0:5928:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1782727229.169112:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1782727229.170704:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727229.170923:0:5928:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1782727229.170961:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1782727229.173588:0:5928:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1782727229.173605:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1782727229.177479:0:5928:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1782727229.177494:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0F:1782727229.179468:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727229.179480:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727229.179483:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727229.186839:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727229.186850:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727229.186853:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727229.189420:0:5928:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1782727229.190369:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1782727229.440436:0:5928:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2211 MB/s 00000001:01000000:0.0:1782727229.690053:0:5928:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5003 MB/s 00000001:01000000:0.0:1782727229.946528:0:5928:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 691 MB/s 00010000:00010000:3.0:1782727230.191264:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1782727230.196227:0:5928:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 679 MB/s 00080000:10000000:3.0:1782727230.207646:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1782727230.239007:0:5928:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1782727230.242112:0:5943:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782727230.242148:0:5928:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782727230.242207:0:5928:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1782727230.243245:0:5928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782727230.243273:0:5928:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1782727230.243801:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727230.244493:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1782727230.244502:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1782727230.252083:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1782727230.252099:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1782727230.252665:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1782727230.252673:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1782727230.272894:0:5928:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1782727230.272919:0:5928:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.123@tcp' 00000020:01000004:2.0:1782727230.272922:0:5928:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1782727230.273006:0:5928:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.123@tcp (typ=mgc) 00000020:00000080:2.0:1782727230.273018:0:5928:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.123@tcp (00000000d1ffa3a2) 00000020:00000080:2.0:1782727230.273034:0:5928:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1782727230.273112:0:5928:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000075b3262a@MGC192.168.204.123@tcp: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1782727230.273312:0:5928:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.123@tcp-0 is initialized 00000040:01000000:2.0:1782727230.273319:0:5928:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 1 is initialized 00000100:00080000:3.0:1782727230.273562:0:5948:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1782727230.287426:0:5949:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1782727230.288079:0:5928:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.123@tcp (uuid 2c805432-a345-4b8b-859c-fa0b2938956c) 00000020:00000080:3.0:1782727230.288111:0:5928:0:(genops.c:1406:class_connect()) connect: client 2c805432-a345-4b8b-859c-fa0b2938956c, cookie 0x9832bf6cd8a42b2b 00000100:00080000:3.0:1782727230.288123:0:5928:0:(import.c:512:import_select_connection()) MGC192.168.204.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782727230.288129:0:5928:0:(import.c:626:import_select_connection()) MGC192.168.204.123@tcp: import 0000000075b3262a using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1782727230.288195:0:5928:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009b6a2be3 x1869324912427136/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782727230.288222:0:5928:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 2c805432-a345-4b8b-859c-fa0b2938956c->MGS 00000020:01000004:3.0:1782727230.288261:0:5928:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1782727230.288266:0:5928:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1782727230.288287:0:5928:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000002aad9216) 00000020:00000080:3.0:1782727230.288311:0:5928:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1782727230.288577:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009b6a2be3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c805432-a345-4b8b-859c-fa0b2938956c:3443:1869324912427136:0@lo:250: 00000100:00100000:1.0:1782727230.288662:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727230.288736:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912427136 00000100:00100000:1.0:1782727230.288744:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912427136 00000100:00100000:1.0:1782727230.288789:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727230.288795:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000573139ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3443:x1869324912427136:12345-0@lo:250: 00010000:00080000:1.0:1782727230.288818:0:5945:0:(ldlm_lib.c:1434:target_handle_connect()) MGS: connection from 2c805432-a345-4b8b-859c-fa0b2938956c@0@lo t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:1.0:1782727230.288841:0:5945:0:(genops.c:1406:class_connect()) connect: client 2c805432-a345-4b8b-859c-fa0b2938956c, cookie 0x9832bf6cd8a42b39 00000100:00080000:1.0:1782727230.289036:0:5945:0:(import.c:65:import_set_state_nolock()) 00000000d387408e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727230.289095:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000573139ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+5:3443:x1869324912427136:12345-0@lo:250: Request processed in 299us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.289103:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727230.289214:0:3443:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1782727230.289222:0:3443:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.123@tcp: connect to target with instance 0 00000100:00080000:2.0:1782727230.289229:0:3443:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1782727230.289233:0:3443:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1782727230.289236:0:3443:0:(import.c:65:import_set_state_nolock()) 0000000075b3262a MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1782727230.289239:0:3443:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1782727230.289257:0:3443:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1782727230.289262:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009b6a2be3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c805432-a345-4b8b-859c-fa0b2938956c:3443:1869324912427136:0@lo:250: 00000100:00100000:1.0:1782727230.296834:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727230.297073:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1782727230.297079:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1782727230.301206:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1782727230.301219:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1782727230.304842:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1782727230.304855:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1782727230.307137:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727230.307408:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1782727230.307416:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1782727230.315612:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1782727230.315639:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782727230.468264:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782727230.468495:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782727230.468501:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1782727230.480032:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1782727230.480047:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1782727230.480989:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727230.481145:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782727230.481158:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1782727230.484752:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782727230.484766:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1782727230.486285:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727230.486445:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782727230.486451:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1782727230.492500:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782727230.492880:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1782727230.494345:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727230.494554:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782727230.494559:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782727230.495071:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782727230.495078:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782727230.543113:0:5928:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727230.543494:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782727230.543501:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782727230.554559:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782727230.554575:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1782727230.559698:0:5928:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782727230.559713:0:5928:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1782727230.564109:0:5928:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1782727230.564147:0:5928:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1782727230.564172:0:5928:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1782727230.564508:0:5928:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782727230.564541:0:5928:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.123@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1782727230.564545:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782727230.564546:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782727230.564548:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727230.564549:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727230.564550:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727230.564551:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727230.564553:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782727230.564554:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782727230.564555:0:5928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727230.564557:0:5928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727230.564558:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727230.564559:0:5928:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727230.564561:0:5928:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1782727230.564563:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782727230.564564:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782727230.564565:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727230.564566:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727230.564567:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727230.564568:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727230.564569:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782727230.564570:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782727230.564571:0:5928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727230.564572:0:5928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727230.564573:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727230.564574:0:5928:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727230.564598:0:5928:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782727230.564613:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002e1531d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427264:0@lo:253: 00000100:00100000:3.0:1782727230.564709:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727230.564762:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 0000000044628a27 going to sleep for 11 seconds 00000100:00100000:2.0:1782727230.564878:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912427264 00000100:00100000:2.0:1782727230.564885:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912427264 00000100:00100000:2.0:1782727230.564966:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727230.564975:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a6dab94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+5:5928:x1869324912427264:12345-0@lo:253: 20000000:01000000:2.0:1782727230.565029:0:5947:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782727230.565032:0:5947:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1782727230.566457:0:5968:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1782727230.566777:0:5947:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1782727230.567474:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727230.577493:0:5969:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1782727230.579038:0:5947:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782727230.579117:0:5947:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1782727230.579125:0:5947:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1782727230.579128:0:5947:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1782727230.579147:0:5947:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1782727230.579506:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727230.582838:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1782727230.582875:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782727230.583782:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1782727230.583811:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1782727230.583828:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1782727230.584402:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1782727230.584416:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1782727230.584435:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1782727230.584440:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1782727230.584451:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1782727230.584454:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1782727230.584464:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1782727230.584476:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1782727230.584509:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1782727230.584515:0:5947:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1782727230.584522:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727230.584707:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1782727230.584717:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782727230.584732:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1782727230.584748:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1782727230.584763:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1782727230.584771:0:5947:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1782727230.584794:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1782727230.584800:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782727230.584811:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1782727230.584827:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1782727230.584860:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1782727230.584875:0:5947:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1782727230.584901:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1782727230.584909:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1782727230.584921:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1782727230.584973:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1782727230.585038:0:5947:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1782727230.585073:0:5947:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1782727230.585080:0:5947:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1782727230.586654:0:5970:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1782727230.588620:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1782727230.588651:0:5947:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.123@tcp for mdt 20000000:01000000:2.0:1782727230.588653:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:2.0:1782727230.588670:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1782727230.588676:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1782727230.588690:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1782727230.588696:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:2.0:1782727230.588708:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1782727230.588716:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1782727230.588728:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1782727230.588742:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1782727230.588772:0:5947:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782727230.588775:0:5947:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782727230.588779:0:5947:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782727230.588851:0:5947:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782727230.588854:0:5947:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782727230.594241:0:5971:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1782727230.594540:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1782727230.594591:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1782727230.594608:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1782727230.594620:0:5947:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782727230.594623:0:5947:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782727230.595375:0:5972:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1782727230.595531:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1782727230.595553:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1782727230.595569:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1782727230.595584:0:5947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727230.595586:0:5947:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1782727230.595591:0:5947:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782727230.595593:0:5947:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782727230.595598:0:5947:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1782727230.595604:0:5947:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1782727230.605993:0:5973:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1782727230.608342:0:5947:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1782727230.620147:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1782727230.620384:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1782727230.620405:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1782727230.620426:0:5947:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782727230.620448:0:5947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.620467:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.620476:0:5947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.620498:0:5947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.620504:0:5947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.620511:0:5947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.620516:0:5947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad3bf2aa already unused, calling callback (000000009bd8b3c0) 00010000:00010000:0.0:1782727230.620520:0:5947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.620527:0:5947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.620539:0:5947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.620546:0:5947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.620552:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad3bf2aa/0x9832bf6cd8a42b40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782727230.620574:0:5947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1782727230.631918:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a6dab94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+5:5928:x1869324912427264:12345-0@lo:253: Request processed in 66936us (67201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727230.631977:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727230.632343:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002e1531d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427264:0@lo:253: 10000000:01000000:3.0:1782727230.632362:0:5928:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782727230.632365:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782727230.632368:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782727230.632369:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727230.632370:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1782727230.632371:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727230.632373:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727230.632374:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782727230.632376:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782727230.632377:0:5928:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782727230.632379:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727230.632380:0:5928:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782727230.632401:0:5928:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fc6d3e95 from lustre-MDT0000 10000000:01000000:3.0:1782727230.632434:0:5928:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782727230.632437:0:5928:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782727230.632442:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cef6cb64d70 10000000:01000000:3.0:1782727230.632446:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782727230.632454:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cef6cb64d70 from 1 10000000:01000000:3.0:1782727230.632457:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727230.632492:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 000000006a326c32/0x9832bf6cd8a42b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727230.632503:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 000000006a326c32/0x9832bf6cd8a42b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727230.632513:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 000000006a326c32/0x9832bf6cd8a42b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727230.632530:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002e1531d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427392:0@lo:101: 00000100:00100000:3.0:1782727230.632585:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727230.632694:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 000000000b7e1b05 going to sleep for 11 seconds 00000100:00100000:1.0:1782727230.632965:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912427392 00000100:00100000:1.0:1782727230.632972:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912427392 00000100:00100000:1.0:1782727230.633019:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782727230.633028:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f498bfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+5:5928:x1869324912427392:12345-0@lo:101: 00010000:00010000:1.0:1782727230.633041:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727230.633055:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d146bbe/0x9832bf6cd8a42b4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42b47 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.633077:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d146bbe/0x9832bf6cd8a42b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42b47 expref: 6 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.633087:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d146bbe/0x9832bf6cd8a42b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42b47 expref: 6 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.633103:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d146bbe, rc 0) 00000100:00100000:1.0:1782727230.633146:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f498bfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+6:5928:x1869324912427392:12345-0@lo:101: Request processed in 120us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.633152:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727230.633255:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002e1531d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427392:0@lo:101: 00010000:00010000:2.0:1782727230.633269:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 000000006a326c32/0x9832bf6cd8a42b47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.633278:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 000000006a326c32/0x9832bf6cd8a42b47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727230.633349:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427520:0@lo:501: 00000100:00100000:2.0:1782727230.633399:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.633423:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ea3fa4e4 going to sleep for 11 seconds 00000100:00100000:0.0:1782727230.634889:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912427520 00000100:00100000:0.0:1782727230.634914:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912427520 00000100:00100000:0.0:1782727230.634978:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782727230.634986:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cecefea3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+6:5928:x1869324912427520:12345-0@lo:501: 00000100:00100000:0.0:1782727230.635111:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cecefea3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+6:5928:x1869324912427520:12345-0@lo:501: Request processed in 126us (1712us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727230.635119:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727230.635529:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427520:0@lo:501: 10000000:01000000:2.0:1782727230.635570:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782727230.635602:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 000000006a326c32/0x9832bf6cd8a42b47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.635612:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 000000006a326c32/0x9832bf6cd8a42b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727230.635621:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cef434e9800 10000000:01000000:2.0:1782727230.635626:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782727230.635631:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cef434e9800 10000000:01000000:2.0:1782727230.635633:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1782727230.635636:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8cef434e9800 from 1 10000000:01000000:2.0:1782727230.635639:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1782727230.635689:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000bba8cbc1/0x9832bf6cd8a42b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.635697:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000bba8cbc1/0x9832bf6cd8a42b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.635706:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000bba8cbc1/0x9832bf6cd8a42b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727230.635722:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427648:0@lo:101: 00000100:00100000:2.0:1782727230.635756:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.635794:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ea3fa4e4 going to sleep for 11 seconds 00000100:00100000:1.0:1782727230.636054:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912427648 00000100:00100000:1.0:1782727230.636059:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912427648 00000100:00100000:1.0:1782727230.636087:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727230.636093:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002f7d783 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+6:5928:x1869324912427648:12345-0@lo:101: 00010000:00010000:1.0:1782727230.636103:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727230.636115:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b14800ae/0x9832bf6cd8a42b5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42b55 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.636135:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b14800ae/0x9832bf6cd8a42b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42b55 expref: 7 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.636144:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b14800ae/0x9832bf6cd8a42b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42b55 expref: 7 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.636340:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b14800ae, rc 0) 00000100:00100000:1.0:1782727230.636388:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002f7d783 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+7:5928:x1869324912427648:12345-0@lo:101: Request processed in 294us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.636394:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727230.636765:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427648:0@lo:101: 00010000:00010000:2.0:1782727230.636778:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000bba8cbc1/0x9832bf6cd8a42b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42b5c expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.636786:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000bba8cbc1/0x9832bf6cd8a42b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42b5c expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727230.636799:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1782727230.636802:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000bba8cbc1/0x9832bf6cd8a42b55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42b5c expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.636807:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000bba8cbc1/0x9832bf6cd8a42b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42b5c expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727230.636814:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1782727230.636819:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782727230.636824:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cef434e9800 10000000:01000000:2.0:1782727230.636826:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1782727230.636835:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1782727230.636837:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782727230.636854:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 000000005a8c8438/0x9832bf6cd8a42b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.636861:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 000000005a8c8438/0x9832bf6cd8a42b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.636868:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 000000005a8c8438/0x9832bf6cd8a42b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727230.636881:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427776:0@lo:101: 00000100:00100000:2.0:1782727230.636912:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.636967:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ea3fa4e4 going to sleep for 11 seconds 00000100:00100000:1.0:1782727230.637630:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912427776 00000100:00100000:1.0:1782727230.637637:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912427776 00000100:00100000:1.0:1782727230.637755:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727230.637763:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7c74348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+7:5928:x1869324912427776:12345-0@lo:101: 00010000:00010000:1.0:1782727230.637775:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727230.637793:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef599e73/0x9832bf6cd8a42b6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42b63 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.637811:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef599e73/0x9832bf6cd8a42b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42b63 expref: 8 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.637820:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef599e73/0x9832bf6cd8a42b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42b63 expref: 8 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.637828:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef599e73, rc 0) 00000100:00100000:1.0:1782727230.637874:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7c74348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+8:5928:x1869324912427776:12345-0@lo:101: Request processed in 112us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.637887:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727230.637976:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427776:0@lo:101: 00010000:00010000:2.0:1782727230.637989:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 000000005a8c8438/0x9832bf6cd8a42b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.637996:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 000000005a8c8438/0x9832bf6cd8a42b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727230.638067:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427904:0@lo:501: 00000100:00100000:2.0:1782727230.638094:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.638126:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ea3fa4e4 going to sleep for 11 seconds 00000100:00100000:1.0:1782727230.638499:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912427904 00000100:00100000:1.0:1782727230.638504:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912427904 00000100:00100000:1.0:1782727230.638539:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727230.638545:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d456c789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+8:5928:x1869324912427904:12345-0@lo:501: 00000100:00100000:1.0:1782727230.638732:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d456c789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+9:5928:x1869324912427904:12345-0@lo:501: Request processed in 187us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.638740:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727230.639346:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912427904:0@lo:501: 00000100:00100000:2.0:1782727230.639470:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428032:0@lo:503: 00000100:00100000:2.0:1782727230.639524:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.639555:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ea3fa4e4 going to sleep for 11 seconds 00000100:00100000:0.0:1782727230.639620:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912428032 00000100:00100000:0.0:1782727230.639624:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912428032 00000100:00100000:0.0:1782727230.639722:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782727230.639730:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9b6dd2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+9:5928:x1869324912428032:12345-0@lo:503: 00000100:00100000:0.0:1782727230.639826:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9b6dd2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+9:5928:x1869324912428032:12345-0@lo:503: Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727230.639833:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727230.639964:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428032:0@lo:503: 00000100:00100000:3.0:1782727230.641758:0:5974:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002e4f0d51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:5974:1869324912428160:0@lo:502: 00000100:00100000:3.0:1782727230.641831:0:5974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727230.641923:0:5974:0:(client.c:2701:ptlrpc_set_wait()) set 0000000073a78a19 going to sleep for 11 seconds 00000100:00100000:1.0:1782727230.642265:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912428160 00000100:00100000:1.0:1782727230.642272:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912428160 00000100:00100000:1.0:1782727230.642361:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727230.642369:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b93448aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+9:5974:x1869324912428160:12345-0@lo:502: 00000100:00100000:1.0:1782727230.642495:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b93448aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+9:5974:x1869324912428160:12345-0@lo:502: Request processed in 126us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.642502:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727230.642580:0:5974:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002e4f0d51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:5974:1869324912428160:0@lo:502: 00000020:01000000:3.0:1782727230.642607:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727230.642617:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727230.642620:0:5974:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782727230.642625:0:5974:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1782727230.642627:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727230.642641:0:5974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005101dc82) 00000020:00000080:3.0:1782727230.642671:0:5974:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1782727230.642678:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782727230.642775:0:5974:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782727230.642782:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9832bf6cd8a42b78 00000020:00000080:3.0:1782727230.643072:0:5974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782727230.643077:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727230.643080:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727230.643082:0:5974:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782727230.643085:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727230.643088:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727230.643090:0:5974:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1782727230.643093:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727230.643100:0:5974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005cd1e05d) 00000020:00000080:3.0:1782727230.643111:0:5974:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1782727230.643115:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782727230.643117:0:5974:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1782727230.643120:0:5974:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1782727230.643125:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782727230.643261:0:5974:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fc6d3e95 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1782727230.643274:0:5974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ca66cade) 00000020:00000080:3.0:1782727230.643281:0:5974:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1782727230.643366:0:5974:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1782727230.643375:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9832bf6cd8a42b8d 00000020:00000080:3.0:1782727230.643471:0:5974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1782727230.643477:0:5974:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1782727230.643481:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9832bf6cd8a42b94 00080000:01000000:3.0:1782727230.643486:0:5974:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1782727230.643489:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9832bf6cd8a42b9b 00080000:10000000:3.0:1782727230.643888:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1782727230.644365:0:5974:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1782727230.653125:0:5974:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1782727230.700289:0:5974:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1782727230.700739:0:5974:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1782727230.708398:0:5974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1782727230.708754:0:5974:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782727230.711282:0:5974:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000005c7c5cfc) 00000020:00000080:2.0:1782727230.711312:0:5974:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1782727230.711821:0:5974:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782727230.711830:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9832bf6cd8a42ba9 00000020:00000080:0.0:1782727230.718196:0:5974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1782727230.719318:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1782727230.721463:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1782727230.725516:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1782727230.728899:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1782727230.735366:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1782727230.743780:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1782727230.746072:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9832bf6cd8a42bb0 00000020:00000080:1.0:1782727230.746583:0:5974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782727230.746594:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727230.746600:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727230.746603:0:5974:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782727230.746606:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727230.746610:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727230.746612:0:5974:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727230.746615:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727230.746616:0:5974:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782727230.746619:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727230.746621:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727230.746623:0:5974:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782727230.746625:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727230.746630:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727230.746631:0:5974:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782727230.746635:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782727230.746669:0:5974:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1782727230.746731:0:5974:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:5974:1869324912428288:0@lo:502: 00000100:00100000:1.0:1782727230.746808:0:5974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727230.746906:0:5974:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c1875abc going to sleep for 11 seconds 00000100:00100000:3.0:1782727230.747192:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912428288 00000100:00100000:3.0:1782727230.747199:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912428288 00000100:00100000:3.0:1782727230.747339:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782727230.747347:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ccb3272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+9:5974:x1869324912428288:12345-0@lo:502: 00000100:00100000:3.0:1782727230.747467:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ccb3272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+9:5974:x1869324912428288:12345-0@lo:502: Request processed in 120us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727230.747474:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727230.747554:0:5974:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:5974:1869324912428288:0@lo:502: 00000020:01000000:1.0:1782727230.747576:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727230.747580:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727230.747581:0:5974:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1782727230.747585:0:5974:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1782727230.747753:0:5928:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1782727230.747773:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782727230.747794:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 000000005a8c8438/0x9832bf6cd8a42b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.747804:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 000000005a8c8438/0x9832bf6cd8a42b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727230.747812:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8cef434e9800 from 1 10000000:01000000:2.0:1782727230.747815:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782727230.747840:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.747848:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.747856:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727230.747869:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428416:0@lo:101: 00000100:00100000:2.0:1782727230.747910:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.748241:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc7f285c going to sleep for 11 seconds 00000100:00100000:0.0:1782727230.748308:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912428416 00000100:00100000:0.0:1782727230.748313:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912428416 00000100:00100000:0.0:1782727230.748340:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782727230.748346:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7ba3a8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+9:5928:x1869324912428416:12345-0@lo:101: 00010000:00010000:0.0:1782727230.748355:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727230.748367:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f4533421/0x9832bf6cd8a42bbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42bb7 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.748385:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4533421/0x9832bf6cd8a42bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bb7 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.748403:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f4533421/0x9832bf6cd8a42bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bb7 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.748411:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f4533421, rc 0) 00000100:00100000:0.0:1782727230.748451:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7ba3a8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+10:5928:x1869324912428416:12345-0@lo:101: Request processed in 106us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727230.748458:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782727230.748590:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428416:0@lo:101: 00010000:00010000:2.0:1782727230.748601:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.748609:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727230.749407:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428544:0@lo:256: 00000100:00100000:2.0:1782727230.749450:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.749470:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc7f285c going to sleep for 11 seconds 00000100:00100000:3.0:1782727230.749561:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912428544 00000100:00100000:3.0:1782727230.749567:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912428544 00000100:00100000:3.0:1782727230.749594:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782727230.749600:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a45b368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+10:5928:x1869324912428544:12345-0@lo:256: 20000000:01000000:3.0:1782727230.749617:0:5945:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1782727230.749623:0:5945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1782727230.749698:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a45b368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+10:5928:x1869324912428544:12345-0@lo:256: Request processed in 98us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727230.749705:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782727230.749826:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428544:0@lo:256: 10000000:01000000:2.0:1782727230.750529:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782727230.750553:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.750562:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727230.750569:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8cef434e9800 from 1 10000000:01000000:2.0:1782727230.750572:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727230.750598:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.750605:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.750612:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727230.750646:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428672:0@lo:101: 00000100:00100000:2.0:1782727230.750675:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.750815:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc7f285c going to sleep for 11 seconds 00000100:00100000:1.0:1782727230.750983:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912428672 00000100:00100000:1.0:1782727230.750989:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912428672 00000100:00100000:0.0:1782727230.751124:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727230.751133:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058de2754 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+10:5928:x1869324912428672:12345-0@lo:101: 00010000:00010000:0.0:1782727230.751143:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727230.751166:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42bcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42bc5 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.751185:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bc5 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.751194:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bc5 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.751201:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cf47663, rc 0) 00000100:00100000:0.0:1782727230.751252:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058de2754 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+11:5928:x1869324912428672:12345-0@lo:101: Request processed in 122us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727230.751258:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782727230.751395:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428672:0@lo:101: 00010000:00010000:2.0:1782727230.751406:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.751414:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727230.751465:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428800:0@lo:501: 00000100:00100000:2.0:1782727230.751490:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.751515:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc7f285c going to sleep for 11 seconds 00000100:00100000:0.0:1782727230.751569:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912428800 00000100:00100000:0.0:1782727230.751574:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912428800 00000100:00100000:0.0:1782727230.751608:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727230.751615:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057eeea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:5928:x1869324912428800:12345-0@lo:501: 00000100:00100000:0.0:1782727230.751853:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057eeea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:5928:x1869324912428800:12345-0@lo:501: Request processed in 238us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727230.751860:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782727230.752333:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428800:0@lo:501: 00000100:00100000:2.0:1782727230.752362:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428928:0@lo:503: 00000100:00100000:2.0:1782727230.752401:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.752461:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc7f285c going to sleep for 11 seconds 00000100:00100000:3.0:1782727230.752497:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912428928 00000100:00100000:3.0:1782727230.752502:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912428928 00000100:00100000:3.0:1782727230.752556:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727230.752563:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8609995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+11:5928:x1869324912428928:12345-0@lo:503: 00000040:00080000:3.0:1782727230.752602:0:5945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782727230.752649:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8609995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+11:5928:x1869324912428928:12345-0@lo:503: Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727230.752656:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782727230.752721:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000005d44935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912428928:0@lo:503: 00000040:00080000:2.0:1782727230.753750:0:5978:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1782727230.754041:0:5928:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1782727230.754058:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782727230.754074:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.754085:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727230.754135:0:5928:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782727230.754137:0:5928:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cef434e9800 10000000:01000000:0.0:1782727230.754141:0:5928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cef434e9800 10000000:01000000:0.0:1782727230.754145:0:5928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782727230.754150:0:5928:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cef434e9800 from 1 10000000:01000000:0.0:1782727230.754153:0:5928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727230.754201:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 000000008476a64b/0x9832bf6cd8a42bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.754210:0:5928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 000000008476a64b/0x9832bf6cd8a42bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.754228:0:5928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 000000008476a64b/0x9832bf6cd8a42bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727230.754243:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a8b59a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912429056:0@lo:101: 00000100:00100000:0.0:1782727230.754281:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727230.754778:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c8645429 going to sleep for 11 seconds 00000100:00100000:1.0:1782727230.754856:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912429056 00000100:00100000:1.0:1782727230.754863:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912429056 00000100:00100000:1.0:1782727230.754904:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782727230.754912:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa2c5fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+11:5928:x1869324912429056:12345-0@lo:101: 00010000:00010000:1.0:1782727230.754983:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727230.754996:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000916e2421/0x9832bf6cd8a42bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42bd3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.755029:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000916e2421/0x9832bf6cd8a42bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bd3 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.755038:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000916e2421/0x9832bf6cd8a42bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bd3 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.755046:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000916e2421, rc 0) 00000100:00100000:1.0:1782727230.755083:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa2c5fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5928:x1869324912429056:12345-0@lo:101: Request processed in 173us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.755090:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727230.755347:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a8b59a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912429056:0@lo:101: 00010000:00010000:0.0:1782727230.755361:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 000000008476a64b/0x9832bf6cd8a42bd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.755369:0:5928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 000000008476a64b/0x9832bf6cd8a42bd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727230.755427:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a8b59a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912429184:0@lo:501: 00000100:00100000:0.0:1782727230.755453:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727230.755479:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c8645429 going to sleep for 11 seconds 00000100:00100000:1.0:1782727230.755553:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912429184 00000100:00100000:1.0:1782727230.755558:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912429184 00000100:00100000:1.0:1782727230.755575:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782727230.755580:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013ac6804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5928:x1869324912429184:12345-0@lo:501: 00000100:00100000:1.0:1782727230.755695:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013ac6804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5928:x1869324912429184:12345-0@lo:501: Request processed in 115us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.755702:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727230.755762:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a8b59a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912429184:0@lo:501: 00000100:00100000:0.0:1782727230.755786:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a8b59a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912429312:0@lo:503: 00000100:00100000:0.0:1782727230.755833:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727230.755853:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c8645429 going to sleep for 11 seconds 00000100:00100000:1.0:1782727230.755899:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912429312 00000100:00100000:1.0:1782727230.755903:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912429312 00000100:00100000:1.0:1782727230.755918:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782727230.755923:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027c522c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5928:x1869324912429312:12345-0@lo:503: 00000100:00100000:1.0:1782727230.756036:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027c522c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5928:x1869324912429312:12345-0@lo:503: Request processed in 113us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.756043:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727230.756239:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a8b59a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912429312:0@lo:503: 00000100:00100000:0.0:1782727230.756619:0:5979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a8b59a24 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:5979:1869324912429440:0@lo:502: 00000100:00100000:0.0:1782727230.756652:0:5979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727230.756681:0:5979:0:(client.c:2701:ptlrpc_set_wait()) set 000000008d8877a4 going to sleep for 11 seconds 00000100:00100000:1.0:1782727230.756719:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912429440 00000100:00100000:1.0:1782727230.756723:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912429440 00000100:00100000:1.0:1782727230.756742:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727230.756747:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000647ba2b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5979:x1869324912429440:12345-0@lo:502: 00000100:00100000:1.0:1782727230.756823:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000647ba2b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5979:x1869324912429440:12345-0@lo:502: Request processed in 75us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.756829:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727230.756908:0:5979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a8b59a24 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:5979:1869324912429440:0@lo:502: 00000020:01000004:0.0:1782727230.756985:0:5979:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1782727230.756999:0:5979:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000abf0ce63) 00000020:00000080:0.0:1782727230.757135:0:5979:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1782727230.757322:0:5979:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fc6d3e95 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782727230.757326:0:5979:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000fc6d3e95 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782727230.757329:0:5979:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000fc6d3e95 4 00010000:00080000:0.0:1782727230.757357:0:5979:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ec55dfe3@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:0.0:1782727230.769494:0:5979:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1782727230.769604:0:5979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1782727230.769649:0:5979:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782727230.769661:0:5979:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9832bf6cd8a42be8 00000100:00080000:0.0:1782727230.769671:0:5979:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782727230.769677:0:5979:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ec55dfe3 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:0.0:1782727230.769714:0:5979:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a8b59a24 x1869324912429568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782727230.769780:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a8b59a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869324912429568:0@lo:38: 00000100:00100000:2.0:1782727230.769854:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782727230.770167:0:5979:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782727230.770384:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912429568 00000100:00100000:1.0:1782727230.770392:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912429568 00000100:00100000:1.0:1782727230.770437:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727230.770444:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005d44935 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3443:x1869324912429568:12345-0@lo:38: 00000100:00100000:1.0:1782727230.770860:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005d44935 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3443:x1869324912429568:12345-0@lo:38: Request processed in 414us (1005us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782727230.770867:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727230.776199:0:5979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000950fa419 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:5979:1869324912429696:0@lo:502: 00000100:00100000:0.0:1782727230.776292:0:5979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727230.776333:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912429696 00000100:00100000:0.0:1782727230.776340:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912429696 00000100:00100000:0.0:1782727230.776382:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727230.776390:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053dac010 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5979:x1869324912429696:12345-0@lo:502: 00000100:00100000:0.0:1782727230.776505:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053dac010 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5979:x1869324912429696:12345-0@lo:502: Request processed in 116us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727230.776513:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727230.776566:0:5979:0:(client.c:2701:ptlrpc_set_wait()) set 000000008d8877a4 going to sleep for 11 seconds 00000100:00100000:0.0:1782727230.776586:0:5979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000950fa419 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:5979:1869324912429696:0@lo:502: 00000040:00080000:0.0:1782727230.776611:0:5979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1782727230.777472:0:5928:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1782727230.777498:0:5928:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727230.777523:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 000000008476a64b/0x9832bf6cd8a42bd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727230.777543:0:5928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 000000008476a64b/0x9832bf6cd8a42bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782727230.777601:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782727230.777603:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782727230.777604:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727230.777605:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727230.777607:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727230.777608:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727230.777610:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782727230.777611:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782727230.777612:0:5928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727230.777613:0:5928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727230.777615:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727230.777616:0:5928:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782727230.777620:0:5928:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1782727230.777623:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782727230.777624:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782727230.777625:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727230.777626:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727230.777627:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727230.777628:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727230.777629:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782727230.777630:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782727230.777631:0:5928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727230.777632:0:5928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727230.777633:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727230.777634:0:5928:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782727230.777651:0:5928:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782727230.777662:0:5928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000950fa419 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912429824:0@lo:253: 00000100:00100000:0.0:1782727230.777703:0:5928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727230.777728:0:5928:0:(client.c:2701:ptlrpc_set_wait()) set 000000008d8877a4 going to sleep for 11 seconds 00000100:00100000:3.0:1782727230.778143:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912429824 00000100:00100000:3.0:1782727230.778149:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912429824 00000100:00100000:3.0:1782727230.778198:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727230.778205:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e278abf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+12:5928:x1869324912429824:12345-0@lo:253: 20000000:01000000:3.0:1782727230.778296:0:5947:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782727230.778311:0:5947:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1782727230.780359:0:3443:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782727230.780370:0:3443:0:(import.c:65:import_set_state_nolock()) 00000000ec55dfe3 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782727230.780377:0:3443:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782727230.780393:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a8b59a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869324912429568:0@lo:38: 20000000:01000000:3.0:1782727230.784796:0:5947:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782727230.784815:0:5947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1782727230.785338:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e278abf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+12:5928:x1869324912429824:12345-0@lo:253: Request processed in 7129us (7630us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727230.785352:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782727230.785443:0:5928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000950fa419 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:5928:1869324912429824:0@lo:253: 10000000:01000000:1.0:1782727230.785457:0:5928:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782727230.785461:0:5928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782727230.785463:0:5928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727230.785464:0:5928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727230.785465:0:5928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727230.785466:0:5928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727230.785468:0:5928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727230.785469:0:5928:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727230.785470:0:5928:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727230.785472:0:5928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727230.785473:0:5928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727230.785474:0:5928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727230.785476:0:5928:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782727230.785495:0:5928:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1782727230.787331:0:5968:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782727230.787340:0:5968:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782727230.787367:0:5968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.787386:0:5968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f4533421/0x9832bf6cd8a42bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bb7 expref: 11 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.787395:0:5968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.787435:0:5968:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f4533421/0x9832bf6cd8a42bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42bb7 expref: 11 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.787453:0:5968:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f4533421/0x9832bf6cd8a42bbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bb7 expref: 11 pid: 5947 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727230.787466:0:5968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000598d14eb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869324912429952:0@lo:104: 00000100:00100000:2.0:1782727230.787529:0:5968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.787588:0:5968:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc7f285c going to sleep for 11 seconds 00000100:00100000:3.0:1782727230.787648:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912429952 00000100:00100000:3.0:1782727230.787656:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912429952 00000100:00100000:3.0:1782727230.787711:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727230.787720:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d6c69a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c805432-a345-4b8b-859c-fa0b2938956c+3:5968:x1869324912429952:12345-0@lo:104: 00010000:00010000:3.0:1782727230.787732:0:5934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727230.787787:0:5934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727230.787792:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d6c69a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c805432-a345-4b8b-859c-fa0b2938956c+3:5968:x1869324912429952:12345-0@lo:104: Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727230.787799:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1782727230.787819:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727230.787823:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727230.787846:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000515835fb already unused, calling callback (000000004bf42d9d) 10000000:00010000:3.0:1782727230.787849:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727230.787857:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727230.787863:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727230.787869:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727230.787907:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727230.787914:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727230.788086:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727230.788094:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: 00000000515835fb/0x9832bf6cd8a42bb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42bbe expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727230.788113:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727230.788115:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727230.788117:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727230.789149:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002e4f0d51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912430080:0@lo:103: 00000100:00100000:3.0:1782727230.789211:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727230.789456:0:5968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000598d14eb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869324912429952:0@lo:104: 00010000:00010000:2.0:1782727230.789478:0:5968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727230.792876:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912430080 00000100:00100000:1.0:1782727230.792892:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912430080 00010000:00010000:1.0:1782727230.794144:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f4533421/0x9832bf6cd8a42bbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bb7 expref: 12 pid: 5947 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727230.794495:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727230.794509:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000528993e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+12:3445:x1869324912430080:12345-0@lo:103: 00010000:00010000:1.0:1782727230.794659:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727230.794663:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f4533421/0x9832bf6cd8a42bbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bb7 expref: 12 pid: 5947 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.794676:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f4533421/0x9832bf6cd8a42bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bb7 expref: 12 pid: 5947 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.794948:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f4533421/0x9832bf6cd8a42bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42bb7 expref: 12 pid: 5947 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.794963:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.794968:0:5936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782727230.794993:0:5936:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007653525s 00010000:00010000:1.0:1782727230.794996:0:5936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.795000:0:5936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.795004:0:5936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.796109:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.796125:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8fda6bb already unused, calling callback (000000009bd8b3c0) 00010000:00010000:1.0:1782727230.796129:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.796137:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.796169:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727230.796181:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727230.796327:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000528993e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+11:3445:x1869324912430080:12345-0@lo:103: Request processed in 1823us (7114us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727230.796337:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727230.796464:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002e4f0d51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912430080:0@lo:103: 00010000:00010000:2.0:1782727230.796533:0:5968:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.796541:0:5968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727230.796558:0:5968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42bef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1782727230.796618:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1782727230.796802:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1782727230.797384:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1782727230.797551:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1782727230.797746:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1782727230.797884:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1782727230.798667:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1782727230.798815:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1782727230.811792:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1782727230.816406:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1782727230.816722:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1782727230.816881:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1782727230.827427:0:5928:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1782727230.839868:0:5928:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1782727230.841335:0:5985:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1782727230.841637:0:5984:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1782727230.841643:0:5984:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1782727230.844724:0:5985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1782727230.848732:0:5928:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1782727230.848894:0:5928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1782727230.851595:0:5928:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782727230.851614:0:5928:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1782727230.851831:0:5928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727230.853328:0:5985:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782727230.853429:0:5985:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1782727230.853435:0:5985:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1782727230.856729:0:5928:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782727230.857379:0:5928:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782727230.858600:0:5928:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1782727230.858866:0:5928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1782727230.859165:0:5928:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1782727230.863518:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1782727230.863751:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1782727230.866915:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1782727230.867911:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1782727230.871177:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1782727230.871490:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1782727230.874735:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1782727230.876363:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1782727230.876651:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1782727230.876770:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1782727230.876948:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1782727230.877061:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1782727230.877190:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1782727230.877319:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1782727230.877442:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1782727230.877777:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1782727230.878111:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1782727230.878265:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1782727230.878380:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1782727230.878587:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1782727230.878700:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1782727230.878821:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1782727230.878963:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1782727230.879076:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1782727230.879212:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1782727230.879348:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1782727230.879528:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1782727230.879646:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1782727230.879769:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1782727230.879918:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1782727230.880117:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1782727230.880251:0:5928:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1782727230.880435:0:5928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1782727230.889859:0:5928:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782727230.890179:0:5928:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa41081c9b988 00100000:10000000:3.0:1782727230.890188:0:5928:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1782727230.891031:0:5928:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782727230.891055:0:5928:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782727230.891073:0:5928:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1782727230.891103:0:5928:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1782727230.894529:0:5928:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727230.894785:0:5928:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1782727231.215057:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727232.247278:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727233.263187:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727234.289392:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727235.312677:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727235.518612:0:6229:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1782727236.079279:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1782727236.079289:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782727236.079293:0:37:0:(import.c:65:import_set_state_nolock()) 00000000ec55dfe3 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782727236.079304:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ec55dfe3 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:0.0:1782727236.079323:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000694a5ef3 x1869324912430336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782727236.079468:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727236.079482:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a4647ebc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912430208:0@lo:400: 00000100:00100000:2.0:1782727236.079552:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727236.079615:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000694a5ef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869324912430336:0@lo:38: 00000100:00100000:2.0:1782727236.079664:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727236.079710:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912430336 00000100:00100000:2.0:1782727236.079717:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912430336 00000100:00100000:2.0:1782727236.079749:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727236.079755:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000598d14eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3443:x1869324912430336:12345-0@lo:38: 00010000:00080000:2.0:1782727236.079779:0:5954:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:2.0:1782727236.079818:0:5954:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9832bf6cd8a42bf6 00000004:00100000:2.0:1782727236.079907:0:5954:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782727236.080090:0:5954:0:(import.c:65:import_set_state_nolock()) 00000000758c1d9b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727236.080162:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000598d14eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869324912430336:12345-0@lo:38: Request processed in 405us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727236.080169:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782727236.080644:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000694a5ef3 x1869324912430336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782727236.080659:0:3443:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782727236.080666:0:3443:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782727236.080670:0:3443:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782727236.080672:0:3443:0:(import.c:65:import_set_state_nolock()) 00000000ec55dfe3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782727236.080678:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000694a5ef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869324912430336:0@lo:38: 00000100:00100000:0.0:1782727236.081387:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912430208 00000100:00100000:0.0:1782727236.081394:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912430208 00000100:00100000:0.0:1782727236.081437:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782727236.081443:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002203f2c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+11:3447:x1869324912430208:12345-0@lo:400: 00000100:00100000:0.0:1782727236.081489:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002203f2c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+11:3447:x1869324912430208:12345-0@lo:400: Request processed in 47us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727236.081495:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727236.081577:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a4647ebc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912430208:0@lo:400: 00010000:00010000:1.0:1782727236.336245:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782727236.591811:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782727236.591819:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8cef434e9800 from 3 10000000:01000000:3.0:1782727236.591824:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782727236.591875:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 0000000000131124/0x9832bf6cd8a42bfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727236.591888:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 0000000000131124/0x9832bf6cd8a42bfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727236.591899:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 0000000000131124/0x9832bf6cd8a42bfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727236.591923:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002e4f0d51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912430464:0@lo:101: 00000100:00100000:3.0:1782727236.592488:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727236.592588:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bf289474 going to sleep for 11 seconds 00000100:00100000:2.0:1782727236.596339:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912430464 00000100:00100000:2.0:1782727236.596352:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912430464 00000100:00100000:2.0:1782727236.596428:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782727236.596437:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6c549a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:5949:x1869324912430464:12345-0@lo:101: 00010000:00010000:2.0:1782727236.596459:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727236.596480:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42c04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42bfd expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727236.596508:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bfd expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727236.596537:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a8fda6bb/0x9832bf6cd8a42c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bfd expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727236.596547:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a8fda6bb, rc 0) 00000100:00100000:2.0:1782727236.596628:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6c549a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+12:5949:x1869324912430464:12345-0@lo:101: Request processed in 191us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727236.596635:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727236.598260:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002e4f0d51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912430464:0@lo:101: 00010000:00010000:0.0:1782727236.598286:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 0000000000131124/0x9832bf6cd8a42bfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727236.598323:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 0000000000131124/0x9832bf6cd8a42bfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727236.598394:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000017cbd1a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912430592:0@lo:256: 00000100:00100000:0.0:1782727236.598461:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727236.598508:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d5cec8be going to sleep for 11 seconds 00000100:00100000:1.0:1782727236.599415:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912430592 00000100:00100000:1.0:1782727236.599425:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912430592 00000100:00100000:1.0:1782727236.599638:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727236.599647:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f9224ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5949:x1869324912430592:12345-0@lo:256: 20000000:01000000:1.0:1782727236.599674:0:5946:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782727236.599697:0:5946:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782727236.599700:0:5946:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1782727236.599818:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f9224ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5949:x1869324912430592:12345-0@lo:256: Request processed in 172us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727236.599826:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727236.599891:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000017cbd1a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912430592:0@lo:256: 10000000:01000000:0.0:1782727236.599953:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782727236.599962:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 0000000000131124/0x9832bf6cd8a42bfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727236.599971:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 0000000000131124/0x9832bf6cd8a42bfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:1.0:1782727236.701576:0:6282:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727236.701836:0:6282:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727237.359845:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727238.383276:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782727239.335597:0:6383:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727239.335774:0:6383:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727239.408630:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727240.433885:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782727240.645420:0:6432:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7e083a30 20000000:00000080:3.0:1782727240.645439:0:6432:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cef4696cc00 uarg=0000000000000000 20000000:01000000:3.0:1782727240.645478:0:6432:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782727240.645485:0:6432:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782727240.645489:0:6432:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782727240.645553:0:6432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782727240.645563:0:6432:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1782727240.662751:0:6432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727240.663185:0:6432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782727240.663220:0:6432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1782727240.663235:0:6432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1782727240.663252:0:6432:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782727240.663270:0:6432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727240.663290:0:6432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42bcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bc5 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727240.663297:0:6432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727240.663336:0:6432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42bc5 expref: 11 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727240.663358:0:6432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42bcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bc5 expref: 11 pid: 5945 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727240.663372:0:6432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6432:1869324912430720:0@lo:104: 00000100:00100000:1.0:1782727240.663439:0:6432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727240.663700:0:6432:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c5d67c55 going to sleep for 11 seconds 00000100:00100000:2.0:1782727240.663758:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912430720 00000100:00100000:2.0:1782727240.663766:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912430720 00000100:00100000:2.0:1782727240.663852:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727240.663860:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d785b1d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:6432:x1869324912430720:12345-0@lo:104: 00010000:00010000:2.0:1782727240.663873:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727240.663950:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727240.663956:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d785b1d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:6432:x1869324912430720:12345-0@lo:104: Request processed in 97us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727240.663971:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727240.664041:0:6432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6432:1869324912430720:0@lo:104: 00010000:00010000:1.0:1782727240.664058:0:6432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727240.664163:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727240.664169:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727240.664176:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a9a9077d already unused, calling callback (000000004bf42d9d) 10000000:00010000:0.0:1782727240.664179:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727240.664187:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727240.664205:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727240.664211:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782727240.664244:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727240.664250:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727240.664268:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727240.664273:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: 00000000a9a9077d/0x9832bf6cd8a42bc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42bcc expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727240.664290:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727240.664291:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727240.664292:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727240.664302:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000017cbd1a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912430848:0@lo:103: 00000100:00100000:0.0:1782727240.664331:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727240.664455:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912430848 00000100:00100000:3.0:1782727240.664464:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912430848 00010000:00010000:3.0:1782727240.664585:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42bcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bc5 expref: 12 pid: 5945 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727240.664694:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727240.664702:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075aa52d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+12:3447:x1869324912430848:12345-0@lo:103: 00010000:00010000:3.0:1782727240.664712:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727240.664715:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42bcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bc5 expref: 12 pid: 5945 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664724:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bc5 expref: 12 pid: 5945 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664734:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42bcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42bc5 expref: 12 pid: 5945 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664747:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664754:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664766:0:5937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664772:0:5937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664778:0:5937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664783:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664793:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b4c0095 already unused, calling callback (000000009bd8b3c0) 00010000:00010000:3.0:1782727240.664796:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664803:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664823:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727240.664832:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727240.664862:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075aa52d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+11:3447:x1869324912430848:12345-0@lo:103: Request processed in 162us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727240.664869:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1782727240.664908:0:6432:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727240.664914:0:6432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727240.664920:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b4c0095/0x9832bf6cd8a42c0b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727240.667103:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000017cbd1a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912430848:0@lo:103: 00000100:00100000:0.0:1782727241.199486:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912430976:0@lo:400: 00000100:00100000:0.0:1782727241.199573:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727241.199636:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727241.199643:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d270ab6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912431104:0@lo:400: 00000100:00100000:0.0:1782727241.199673:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727241.199821:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912431104 00000100:00100000:1.0:1782727241.199830:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912431104 00000100:00100000:1.0:1782727241.199886:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727241.199895:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da444096 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912431104:12345-0@lo:400: 00000100:00100000:1.0:1782727241.199979:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da444096 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912431104:12345-0@lo:400: Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727241.199987:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727241.200516:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912430976 00000100:00100000:2.0:1782727241.200522:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912430976 00000100:00100000:2.0:1782727241.200553:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727241.200560:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcb50b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:3444:x1869324912430976:12345-0@lo:400: 00010000:00080000:1.0:1782727241.203612:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d270ab6d x1869324912431104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727241.203629:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d270ab6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912431104:0@lo:400: 00000100:00100000:1.0:1782727241.204164:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912430976:0@lo:400: 00000100:00100000:2.0:1782727241.204173:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcb50b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:3444:x1869324912430976:12345-0@lo:400: Request processed in 3609us (4597us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727241.204187:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1782727241.455092:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727242.482140:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782727242.863898:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727242.863906:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8cef434e9800 from 1 10000000:01000000:1.0:1782727242.863910:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727242.864225:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 000000000fddce02/0x9832bf6cd8a42c12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727242.864301:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 000000000fddce02/0x9832bf6cd8a42c12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727242.864312:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 000000000fddce02/0x9832bf6cd8a42c12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727242.864335:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912431232:0@lo:101: 00000100:00100000:1.0:1782727242.864398:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727242.864448:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set 0000000098e421ea going to sleep for 11 seconds 00000100:00100000:0.0:1782727242.864800:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912431232 00000100:00100000:0.0:1782727242.864807:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912431232 00000100:00100000:0.0:1782727242.864862:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727242.864870:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003981e717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+11:5949:x1869324912431232:12345-0@lo:101: 00010000:00010000:0.0:1782727242.864884:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727242.864896:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42c19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42c12 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727242.864940:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42c19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c12 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727242.864951:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cf47663/0x9832bf6cd8a42c19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c12 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727242.864959:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cf47663, rc 0) 00000100:00100000:0.0:1782727242.864995:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003981e717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:5949:x1869324912431232:12345-0@lo:101: Request processed in 126us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727242.865002:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727242.865351:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912431232:0@lo:101: 00010000:00010000:1.0:1782727242.865366:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 000000000fddce02/0x9832bf6cd8a42c12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727242.865374:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 000000000fddce02/0x9832bf6cd8a42c12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727242.865436:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912431360:0@lo:501: 00000100:00100000:1.0:1782727242.865466:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727242.865496:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set 0000000098e421ea going to sleep for 11 seconds 00000100:00100000:0.0:1782727242.866042:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912431360 00000100:00100000:0.0:1782727242.866048:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912431360 00000100:00100000:0.0:1782727242.866079:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782727242.866086:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c70bf8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:5949:x1869324912431360:12345-0@lo:501: 00000100:00100000:0.0:1782727242.866192:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c70bf8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:5949:x1869324912431360:12345-0@lo:501: Request processed in 107us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727242.866689:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727242.866777:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912431360:0@lo:501: 00000100:00100000:1.0:1782727242.866813:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912431488:0@lo:503: 00000100:00100000:1.0:1782727242.866854:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727242.866880:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set 0000000098e421ea going to sleep for 11 seconds 00000100:00100000:0.0:1782727242.866887:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912431488 00000100:00100000:0.0:1782727242.866892:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912431488 00000100:00100000:0.0:1782727242.866950:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782727242.866957:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b5a4e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+12:5949:x1869324912431488:12345-0@lo:503: 00000100:00100000:0.0:1782727242.867036:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b5a4e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+12:5949:x1869324912431488:12345-0@lo:503: Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727242.867043:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782727242.867074:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e0fb4c39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912431488:0@lo:503: 00000100:00100000:3.0:1782727242.867710:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000041d38cc3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:6523:1869324912431616:0@lo:502: 00000100:00100000:3.0:1782727242.867748:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727242.867782:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c0c62d66 going to sleep for 11 seconds 00000100:00100000:0.0:1782727242.868372:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912431616 00000100:00100000:0.0:1782727242.868378:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912431616 00000100:00100000:0.0:1782727242.868419:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782727242.868426:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2aaccb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:6523:x1869324912431616:12345-0@lo:502: 00000100:00100000:0.0:1782727242.869355:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2aaccb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:6523:x1869324912431616:12345-0@lo:502: Request processed in 927us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727242.869366:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782727242.869773:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000041d38cc3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:6523:1869324912431616:0@lo:502: 00000020:01000000:2.0:1782727242.869804:0:6523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727242.869814:0:6523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727242.869817:0:6523:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782727242.869825:0:6523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cef434e9800 00000020:00000080:2.0:1782727242.869827:0:6523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782727242.869877:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:6523:1869324912431744:0@lo:502: 00000100:00100000:2.0:1782727242.870369:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727242.870748:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6cadd000 going to sleep for 11 seconds 00000100:00100000:1.0:1782727242.870785:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912431744 00000100:00100000:1.0:1782727242.870791:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912431744 00000100:00100000:1.0:1782727242.870871:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782727242.870879:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:6523:x1869324912431744:12345-0@lo:502: 00000100:00100000:1.0:1782727242.871021:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:6523:x1869324912431744:12345-0@lo:502: Request processed in 143us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727242.871028:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782727242.871093:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:6523:1869324912431744:0@lo:502: 00000020:01000000:3.0:1782727242.871118:0:6523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727242.871123:0:6523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727242.871125:0:6523:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782727242.871129:0:6523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1782727242.871207:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782727242.871295:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727242.871306:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82045e00/0x9832bf6cd8a42c12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727242.871316:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef82045e00/0x9832bf6cd8a42c12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727243.505529:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727244.539971:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727245.556307:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727246.321653:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727246.321706:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727246.321727:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912432000:0@lo:400: 00000100:00100000:1.0:1782727246.321791:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727246.321859:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912432000 00000100:00100000:1.0:1782727246.321866:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912432000 00000100:00100000:1.0:1782727246.321943:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727246.321952:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912432000:12345-0@lo:400: 00000100:00100000:1.0:1782727246.322001:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912432000:12345-0@lo:400: Request processed in 50us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727246.322008:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782727246.322047:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cef6d9d2a00 x1869324912432000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727246.322059:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912432000:0@lo:400: 00000100:00100000:3.0:1782727246.322342:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912431872:0@lo:400: 00000100:00100000:3.0:1782727246.322376:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727246.325417:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912431872 00000100:00100000:2.0:1782727246.325430:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912431872 00000100:00100000:2.0:1782727246.325485:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782727246.325494:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:3447:x1869324912431872:12345-0@lo:400: 00000100:00100000:2.0:1782727246.325578:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:3447:x1869324912431872:12345-0@lo:400: Request processed in 85us (3201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727246.325585:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782727246.325634:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912431872:0@lo:400: 00010000:00010000:0.0:1782727246.575204:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727247.603131:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727248.624973:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727249.649989:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727250.685063:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782727251.028822:0:6932:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782727251.028832:0:6932:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1782727251.028833:0:6932:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1782727251.029031:0:6932:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8cef46963800 00000020:01000004:1.0:1782727251.029056:0:6932:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1782727251.029070:0:6932:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782727251.029101:0:6932:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cef6db699d0) 00000020:00000080:1.0:1782727251.029122:0:6932:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1782727251.107973:0:6932:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1782727251.108046:0:6932:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1782727251.136783:0:6932:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782727251.137254:0:6932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782727251.137269:0:6932:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782727251.137285:0:6932:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9832bf6cd8a42c27 00000020:01000004:3.0:1782727251.137295:0:6932:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1782727251.137325:0:6932:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782727251.137330:0:6932:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782727251.137337:0:6932:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782727251.137343:0:6932:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782727251.137370:0:6932:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cef7510b3a0) 00000020:00000080:3.0:1782727251.137384:0:6932:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1782727251.141223:0:6932:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727251.141437:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782727251.141444:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1782727251.153674:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1782727251.153781:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1782727251.155083:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1782727251.155093:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1782727251.160585:0:6932:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727251.160808:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1782727251.161036:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782727251.161669:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782727251.161678:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1782727251.193523:0:6932:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727251.193897:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782727251.193907:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1782727251.197644:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782727251.197667:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1782727251.199647:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782727251.199664:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1782727251.202522:0:6932:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727251.202778:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1782727251.202785:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1782727251.203692:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1782727251.203701:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782727251.250685:0:6932:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727251.251082:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782727251.251090:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782727251.252540:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782727251.252553:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782727251.253199:0:6932:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782727251.253241:0:6932:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1782727251.253250:0:6932:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1782727251.274638:0:6932:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782727251.274683:0:6932:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.123@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1782727251.274687:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782727251.274689:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782727251.274690:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727251.274696:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727251.274697:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727251.274698:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727251.274700:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727251.274701:0:6932:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727251.274702:0:6932:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727251.274703:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727251.274705:0:6932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727251.274708:0:6932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1782727251.274710:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782727251.274711:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782727251.274712:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727251.274713:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727251.274714:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727251.274714:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727251.274715:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727251.274716:0:6932:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727251.274717:0:6932:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727251.274718:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727251.274719:0:6932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727251.274749:0:6932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782727251.274777:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912432128:0@lo:253: 00000100:00100000:3.0:1782727251.274862:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727251.274977:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef78020b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727251.276525:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912432128 00000100:00100000:1.0:1782727251.276538:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912432128 00000100:00100000:1.0:1782727251.276599:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782727251.276606:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912432128:12345-0@lo:253: 20000000:01000000:1.0:1782727251.276659:0:5945:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1782727251.276663:0:5945:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1782727251.276668:0:5945:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1782727251.276671:0:5945:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1782727251.277010:0:5945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727251.277129:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1782727251.277144:0:5945:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1782727251.277161:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1782727251.277168:0:5945:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1782727251.277183:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1782727251.277199:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1782727251.277453:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1782727251.277470:0:5945:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:1.0:1782727251.277472:0:5945:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:1.0:1782727251.277487:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1782727251.277491:0:5945:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782727251.277510:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1782727251.277515:0:5945:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:1.0:1782727251.277526:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1782727251.277531:0:5945:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1782727251.277541:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1782727251.277553:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1782727251.277967:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1782727251.277978:0:5945:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:1.0:1782727251.277980:0:5945:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:1.0:1782727251.277991:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1782727251.277996:0:5945:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1782727251.278006:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1782727251.278010:0:5945:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:1.0:1782727251.278023:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1782727251.278028:0:5945:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1782727251.278041:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1782727251.278057:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1782727251.278069:0:5945:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1782727251.278072:0:5945:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1782727251.278075:0:5945:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1782727251.278114:0:5945:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782727251.278116:0:5945:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782727251.292982:0:6951:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1782727251.293058:0:6951:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1782727251.293077:0:6951:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1782727251.293492:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1782727251.293520:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1782727251.293546:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1782727251.293557:0:5945:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782727251.293559:0:5945:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782727251.296879:0:6952:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1782727251.296949:0:6952:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1782727251.296967:0:6952:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1782727251.297973:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1782727251.298004:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1782727251.298022:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1782727251.298037:0:5945:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782727251.298040:0:5945:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782727251.308417:0:6953:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1782727251.308700:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1782727251.308764:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1782727251.308784:0:5945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1782727251.308803:0:5945:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782727251.308824:0:5945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.308843:0:5945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef82044400/0x9832bf6cd8a42b4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42b47 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.308851:0:5945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42b63 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.308857:0:5945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bd3 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.308864:0:5945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.308906:0:5945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42bd3 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.308921:0:5945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bd3 expref: 12 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727251.308980:0:5945:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5945:1869324912432256:0@lo:104: 00000100:00100000:0.0:1782727251.309045:0:5945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727251.309119:0:5945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42b63 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.309128:0:5945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42b6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42b63 expref: 12 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727251.309148:0:5945:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5945:1869324912432384:0@lo:104: 00000100:00100000:0.0:1782727251.309171:0:5945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727251.309202:0:5945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef82044400/0x9832bf6cd8a42b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42b47 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.309210:0:5945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef82044400/0x9832bf6cd8a42b4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42b47 expref: 12 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727251.309215:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912432256 00000100:00100000:0.0:1782727251.309217:0:5945:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5945:1869324912432512:0@lo:104: 00000100:00100000:2.0:1782727251.309221:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912432256 00000100:00100000:0.0:1782727251.309236:0:5945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727251.309246:0:5945:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef802716c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727251.309256:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912432384 00000100:00100000:2.0:1782727251.309259:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912432384 00000100:00100000:2.0:1782727251.309269:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912432512 00000100:00100000:2.0:1782727251.309271:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912432512 00000100:00100000:2.0:1782727251.309284:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727251.309292:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+5:5945:x1869324912432256:12345-0@lo:104: 00010000:00010000:2.0:1782727251.309307:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.309372:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727251.309378:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+5:5945:x1869324912432256:12345-0@lo:104: Request processed in 88us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727251.309386:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1782727251.309395:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782727251.309403:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1782727251.309403:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727251.309408:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:5945:x1869324912432384:12345-0@lo:104: 00010000:00010000:1.0:1782727251.309411:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef40030800 already unused, calling callback (ffffffffc1462c20) 00010000:00010000:2.0:1782727251.309415:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef41486800/0x9832bf6cd8a42b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727251.309420:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.309429:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727251.309437:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727251.309443:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727251.309449:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727251.309453:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:5945:x1869324912432384:12345-0@lo:104: Request processed in 46us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727251.309458:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727251.309469:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782727251.309472:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727251.309474:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:5945:x1869324912432512:12345-0@lo:104: 00010000:00010000:1.0:1782727251.309479:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727251.309486:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.309495:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42bd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.309502:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42bda expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.309511:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1782727251.309515:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1782727251.309516:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:5945:x1869324912432512:12345-0@lo:104: Request processed in 42us (278us total) trans 0 rc 0/0 00010000:00010000:1.0:1782727251.309519:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef41486800/0x9832bf6cd8a42b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727251.309522:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782727251.309525:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41486800 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:1.0:1782727251.309528:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef41486800/0x9832bf6cd8a42b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.309535:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef41486800/0x9832bf6cd8a42b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.309536:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782727251.309549:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 10000000:00010000:1.0:1782727251.309551:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef41486800/0x9832bf6cd8a42b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727251.309556:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1782727251.309558:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912432640:0@lo:103: 00010000:00010000:1.0:1782727251.309569:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef41486800/0x9832bf6cd8a42b63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.309575:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727251.309579:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef41486800/0x9832bf6cd8a42b63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727251.309585:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782727251.309587:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef41486800/0x9832bf6cd8a42b63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42b6a expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.309597:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727251.309599:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727251.309600:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727251.309604:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912432768:0@lo:103: 00000100:00100000:2.0:1782727251.309635:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727251.309671:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912432640 00000100:00100000:2.0:1782727251.309675:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912432640 00000100:00100000:1.0:1782727251.309690:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912432768 00010000:00010000:2.0:1782727251.309691:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42bda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bd3 expref: 13 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727251.309693:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912432768 00010000:00010000:1.0:1782727251.309706:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42b6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42b63 expref: 14 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727251.309712:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727251.309717:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+14:3445:x1869324912432640:12345-0@lo:103: 00000100:00100000:1.0:1782727251.309720:0:5937:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1782727251.309726:0:5937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1782727251.309727:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727251.309732:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42bda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bd3 expref: 14 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.309741:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bd3 expref: 14 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.309766:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727251.309808:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+14:3445:x1869324912432640:12345-0@lo:103: Request processed in 90us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727251.309815:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727251.309827:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727251.309833:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+13:3445:x1869324912432768:12345-0@lo:103: 00000100:00100000:1.0:1782727251.309839:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912432640:0@lo:103: 00010000:00010000:2.0:1782727251.309840:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727251.309843:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42b6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42b63 expref: 13 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.309851:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42b6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42b63 expref: 13 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.309860:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727251.309893:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+13:3445:x1869324912432768:12345-0@lo:103: Request processed in 60us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727251.309899:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727251.309986:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912432768:0@lo:103: 00010000:00010000:2.0:1782727251.310255:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727251.310257:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727251.310260:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727251.310319:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310327:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41524600 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:3.0:1782727251.310330:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310339:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727251.310345:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727251.310358:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727251.310392:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42b47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310398:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727251.310426:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42b47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310434:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42b47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42b4e expref: -99 pid: 5928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310448:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727251.310450:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727251.310451:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727251.310458:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727251.310469:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912432896:0@lo:103: 00000100:00100000:3.0:1782727251.310502:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727251.310536:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912432896 00000100:00100000:3.0:1782727251.310540:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912432896 00010000:00010000:3.0:1782727251.310559:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef82044400/0x9832bf6cd8a42b4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42b47 expref: 13 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727251.310581:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727251.310587:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+13:3447:x1869324912432896:12345-0@lo:103: 00010000:00010000:3.0:1782727251.310595:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727251.310598:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef82044400/0x9832bf6cd8a42b4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42b47 expref: 13 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310608:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef82044400/0x9832bf6cd8a42b4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42b47 expref: 13 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310628:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310637:0:5936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310650:0:5936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310658:0:5936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310666:0:5936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310673:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310678:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef40031600 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:3.0:1782727251.310683:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310690:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310697:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.310706:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727251.310736:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+13:3447:x1869324912432896:12345-0@lo:103: Request processed in 149us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727251.310751:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727251.310791:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912432896:0@lo:103: 00010000:00010000:0.0:1782727251.311268:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42bd3 expref: 12 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727251.311281:0:5945:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5945:1869324912432256:0@lo:104: 00010000:00010000:0.0:1782727251.311291:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42b6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42b63 expref: 11 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727251.311299:0:5945:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5945:1869324912432384:0@lo:104: 00010000:00010000:0.0:1782727251.311308:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef82044400/0x9832bf6cd8a42b4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42b47 expref: 10 pid: 5946 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727251.311316:0:5945:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5945:1869324912432512:0@lo:104: 00010000:00010000:0.0:1782727251.311331:0:5945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.311340:0:5945:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.311353:0:5945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.311360:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c35 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782727251.311374:0:5945:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782727251.318492:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+9:6932:x1869324912432128:12345-0@lo:253: Request processed in 41870us (43614us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727251.318514:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782727251.318639:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912432128:0@lo:253: 10000000:01000000:3.0:1782727251.318670:0:6932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782727251.318674:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782727251.318676:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782727251.318677:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727251.318679:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1782727251.318680:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727251.318681:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727251.318683:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727251.318685:0:6932:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782727251.318686:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727251.318688:0:6932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782727251.318715:0:6932:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cef46963800 from lustre-OST0000 10000000:01000000:3.0:1782727251.318767:0:6932:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1782727251.318771:0:6932:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782727251.318780:0:6932:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cef6cb64d70 local copy 10000000:01000000:3.0:1782727251.318786:0:6932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727251.319135:0:6932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.319150:0:6932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.319161:0:6932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727251.319183:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433024:0@lo:101: 00000100:00100000:3.0:1782727251.319235:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727251.319546:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef780209c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727251.319845:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912433024 00000100:00100000:2.0:1782727251.319858:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912433024 00000100:00100000:2.0:1782727251.319924:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782727251.319955:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+9:6932:x1869324912433024:12345-0@lo:101: 00010000:00010000:2.0:1782727251.319972:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727251.319994:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42c3c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.320035:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c3c expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.320067:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c3c expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.320078:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41486e00, rc 0) 00000100:00100000:2.0:1782727251.320158:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+10:6932:x1869324912433024:12345-0@lo:101: Request processed in 205us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727251.320166:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782727251.320201:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433024:0@lo:101: 00010000:00010000:3.0:1782727251.320225:0:6932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.320235:0:6932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727251.320372:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433152:0@lo:501: 00000100:00100000:3.0:1782727251.320412:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727251.320449:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef780209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727251.320498:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912433152 00000100:00100000:0.0:1782727251.320504:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912433152 00000100:00100000:0.0:1782727251.320557:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782727251.320567:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+10:6932:x1869324912433152:12345-0@lo:501: 00000100:00100000:0.0:1782727251.320648:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+10:6932:x1869324912433152:12345-0@lo:501: Request processed in 81us (234us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727251.320664:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727251.321168:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433152:0@lo:501: 10000000:01000000:3.0:1782727251.321184:0:6932:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782727251.321210:0:6932:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782727251.321217:0:6932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.321226:0:6932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.321232:0:6932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.321262:0:6932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782727251.321300:0:6932:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cef46963800 10000000:01000000:3.0:1782727251.321306:0:6932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782727251.321312:0:6932:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cef6cb64d70 10000000:01000000:3.0:1782727251.321314:0:6932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1782727251.321318:0:6932:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cef6cb64d70 from 1 10000000:01000000:3.0:1782727251.321336:0:6932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782727251.321365:0:6932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42c4a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.321372:0:6932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42c4a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.321381:0:6932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42c4a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727251.321403:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433280:0@lo:101: 00000100:00100000:3.0:1782727251.321438:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727251.321463:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef780200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727251.321534:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912433280 00000100:00100000:0.0:1782727251.321539:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912433280 00000100:00100000:0.0:1782727251.321589:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782727251.321599:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+10:6932:x1869324912433280:12345-0@lo:101: 00010000:00010000:0.0:1782727251.321610:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727251.321626:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c51 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42c4a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.321646:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c51 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c4a expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.321679:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef40031600/0x9832bf6cd8a42c51 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c4a expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.321689:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef40031600, rc 0) 00000100:00100000:0.0:1782727251.321731:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912433280:12345-0@lo:101: Request processed in 134us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727251.321737:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1782727251.322034:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782727251.322043:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433280:0@lo:101: 00010000:00010000:2.0:1782727251.322047:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.322069:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525e00 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:2.0:1782727251.322076:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.322085:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727251.322095:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.322100:0:6932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42c4a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c51 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727251.322103:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727251.322138:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.322146:0:6932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42c4a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42c51 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.322148:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727251.322175:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727251.322181:0:6932:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782727251.322200:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef41525e00/0x9832bf6cd8a42c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9832bf6cd8a42c43 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.322202:0:6932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42c4a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c51 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.322227:0:6932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef41524600/0x9832bf6cd8a42c4a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c51 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.322238:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782727251.322239:0:6932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 00010000:00010000:2.0:1782727251.322244:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727251.322249:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782727251.322249:0:6932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727251.322259:0:6932:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 00000100:00100000:2.0:1782727251.322263:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:01000000:1.0:1782727251.322263:0:6932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000100:00100000:2.0:1782727251.322287:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912433408:0@lo:103: 00010000:00010000:1.0:1782727251.322307:0:6932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.322316:0:6932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.322326:0:6932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727251.322337:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727251.322351:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433536:0@lo:101: 00000100:00100000:2.0:1782727251.322390:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912433408 00000100:00100000:2.0:1782727251.322397:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912433408 00000100:00100000:1.0:1782727251.322419:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727251.322451:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727251.322452:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef517663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727251.322466:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+11:3446:x1869324912433408:12345-0@lo:103: 00010000:00010000:2.0:1782727251.322479:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782727251.322497:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912433536 00010000:00010000:2.0:1782727251.322498:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9832bf6cd8a42c3c expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727251.322509:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912433536 00010000:00010000:2.0:1782727251.322524:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727251.322573:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+11:3446:x1869324912433408:12345-0@lo:103: Request processed in 110us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727251.322581:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782727251.322587:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727251.322600:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912433536:12345-0@lo:101: 00010000:00010000:1.0:1782727251.322614:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727251.322629:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42c5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42c58 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727251.322634:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912433408:0@lo:103: 00010000:00010000:1.0:1782727251.322662:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c58 expref: 11 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.322672:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c58 expref: 11 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.322680:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef82045200, rc 0) 00000100:00100000:1.0:1782727251.322722:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912433536:12345-0@lo:101: Request processed in 128us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727251.322730:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782727251.322811:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433536:0@lo:101: 00010000:00010000:1.0:1782727251.322823:0:6932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.322831:0:6932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727251.322967:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433664:0@lo:501: 00000100:00100000:1.0:1782727251.322993:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727251.323026:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef492773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727251.323060:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912433664 00000100:00100000:0.0:1782727251.323068:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912433664 00000100:00100000:0.0:1782727251.323110:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782727251.323118:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912433664:12345-0@lo:501: 00000100:00100000:0.0:1782727251.323263:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912433664:12345-0@lo:501: Request processed in 146us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727251.323270:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782727251.323315:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433664:0@lo:501: 00000100:00100000:0.0:1782727251.323357:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433792:0@lo:503: 00000100:00100000:0.0:1782727251.323429:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727251.323443:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef80271300 going to sleep for 11 seconds 00000100:00100000:1.0:1782727251.323524:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912433792 00000100:00100000:1.0:1782727251.323532:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912433792 00000100:00100000:1.0:1782727251.323592:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782727251.323611:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912433792:12345-0@lo:503: 00000100:00100000:1.0:1782727251.323745:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912433792:12345-0@lo:503: Request processed in 135us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727251.323764:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782727251.324358:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433792:0@lo:503: 00000040:00080000:2.0:1782727251.324775:0:6932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782727251.326299:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433920:0@lo:502: 00000100:00100000:2.0:1782727251.326406:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727251.326462:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aac00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727251.326504:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912433920 00000100:00100000:1.0:1782727251.326520:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912433920 00000100:00100000:1.0:1782727251.326595:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782727251.326606:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912433920:12345-0@lo:502: 00000100:00100000:1.0:1782727251.326792:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912433920:12345-0@lo:502: Request processed in 188us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727251.326800:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782727251.326924:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912433920:0@lo:502: 00000040:00080000:2.0:1782727251.328390:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782727251.328436:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1782727251.328459:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1782727251.328479:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1782727251.328496:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1782727251.328510:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1782727251.328571:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434048:0@lo:502: 00000100:00100000:2.0:1782727251.328642:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727251.328684:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aac00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727251.328795:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912434048 00000100:00100000:0.0:1782727251.328828:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912434048 00000100:00100000:0.0:1782727251.328911:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782727251.328923:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912434048:12345-0@lo:502: 00000100:00100000:0.0:1782727251.329170:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912434048:12345-0@lo:502: Request processed in 249us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727251.329179:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782727251.329229:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434048:0@lo:502: 00000040:00080000:2.0:1782727251.329305:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1782727251.329315:0:6932:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1782727251.336574:0:6956:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782727251.336590:0:6956:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1782727251.336597:0:6956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727251.336600:0:6956:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1782727251.336606:0:6956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727251.336628:0:6956:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cef75108000) 00000020:00000080:3.0:1782727251.336665:0:6956:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782727251.336672:0:6956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782727251.337145:0:6956:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cef46963800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1782727251.337158:0:6956:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782727251.337176:0:6956:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9832bf6cd8a42c6d 00010000:00010000:3.0:1782727251.350121:0:6956:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1782727251.350575:0:6956:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1782727251.358518:0:6956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782727251.359063:0:6956:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1782727251.370476:0:6956:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1782727251.370684:0:6956:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1782727251.380681:0:6956:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1782727251.383828:0:6956:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1782727251.383845:0:6956:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727251.383866:0:6956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727251.383869:0:6956:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1782727251.383874:0:6956:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727251.383879:0:6956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727251.383880:0:6956:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727251.383883:0:6956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727251.383885:0:6956:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782727251.383920:0:6956:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727251.383923:0:6956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727251.383924:0:6956:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782727251.383951:0:6956:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1782727251.384123:0:6932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1782727251.384159:0:6932:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782727251.384185:0:6932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.384199:0:6932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727251.384209:0:6932:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8cef46963800 from 1 10000000:01000000:0.0:1782727251.384212:0:6932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782727251.384262:0:6932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.384271:0:6932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.384284:0:6932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727251.384313:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434176:0@lo:101: 00000100:00100000:0.0:1782727251.384403:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727251.384474:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7532ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727251.385827:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912434176 00000100:00100000:3.0:1782727251.385845:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912434176 00000100:00100000:3.0:1782727251.385919:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782727251.385957:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+11:6932:x1869324912434176:12345-0@lo:101: 00010000:00010000:3.0:1782727251.385984:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727251.386004:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42c7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42c74 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.386038:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42c7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c74 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.386050:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42c7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c74 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727251.386060:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41524c00, rc 0) 00000100:00100000:3.0:1782727251.386903:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912434176:12345-0@lo:101: Request processed in 945us (2496us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727251.386912:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782727251.387352:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434176:0@lo:101: 00010000:00010000:0.0:1782727251.387381:0:6932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.387396:0:6932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727251.387653:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434304:0@lo:501: 00000100:00100000:0.0:1782727251.387725:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727251.387797:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7532ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727251.388330:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912434304 00000100:00100000:2.0:1782727251.388340:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912434304 00000100:00100000:2.0:1782727251.388395:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782727251.388406:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912434304:12345-0@lo:501: 00000100:00100000:2.0:1782727251.388569:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912434304:12345-0@lo:501: Request processed in 164us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727251.388577:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782727251.388866:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434304:0@lo:501: 00000100:00100000:3.0:1782727251.388924:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434432:0@lo:503: 00000100:00100000:3.0:1782727251.389009:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727251.389044:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef780209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727251.389377:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912434432 00000100:00100000:0.0:1782727251.389383:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912434432 00000100:00100000:0.0:1782727251.389426:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782727251.389435:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912434432:12345-0@lo:503: 00000100:00100000:0.0:1782727251.389573:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912434432:12345-0@lo:503: Request processed in 139us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727251.389581:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782727251.392136:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434432:0@lo:503: 00000040:00080000:3.0:1782727251.392534:0:6932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782727251.392687:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434560:0@lo:502: 00000100:00100000:3.0:1782727251.392789:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727251.395473:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef780209c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727251.395515:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912434560 00000100:00100000:3.0:1782727251.395525:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912434560 00000100:00100000:3.0:1782727251.395597:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782727251.395607:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912434560:12345-0@lo:502: 00000100:00100000:3.0:1782727251.395806:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912434560:12345-0@lo:502: Request processed in 199us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727251.395826:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782727251.395888:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434560:0@lo:502: 00000040:00080000:3.0:1782727251.396204:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1782727251.396241:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1782727251.396278:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434688:0@lo:502: 00000100:00100000:3.0:1782727251.396330:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727251.396341:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef780209c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727251.396367:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912434688 00000100:00100000:3.0:1782727251.396372:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912434688 00000100:00100000:3.0:1782727251.396393:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782727251.396399:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912434688:12345-0@lo:502: 00000100:00100000:3.0:1782727251.396497:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912434688:12345-0@lo:502: Request processed in 98us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727251.396505:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782727251.396545:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434688:0@lo:502: 00000040:00080000:3.0:1782727251.396579:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1782727251.396586:0:6932:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1782727251.398142:0:6960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727251.398160:0:6960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727251.398163:0:6960:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782727251.398171:0:6960:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cef46963800 00000020:00000080:0.0:1782727251.398174:0:6960:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782727251.398191:0:6960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727251.398194:0:6960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727251.398196:0:6960:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782727251.398199:0:6960:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1782727251.398258:0:6932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1782727251.398289:0:6932:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782727251.398310:0:6932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.398324:0:6932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727251.398379:0:6932:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782727251.398382:0:6932:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cef46963800 10000000:01000000:0.0:1782727251.398387:0:6932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cef46963800 10000000:01000000:0.0:1782727251.398392:0:6932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782727251.398405:0:6932:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cef46963800 from 1 10000000:01000000:0.0:1782727251.398408:0:6932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727251.398457:0:6932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.398466:0:6932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.398479:0:6932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727251.398504:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434816:0@lo:101: 00000100:00100000:0.0:1782727251.398583:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727251.398614:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7532b300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727251.398640:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912434816 00000100:00100000:0.0:1782727251.398648:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912434816 00000100:00100000:0.0:1782727251.398690:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782727251.398699:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:6932:x1869324912434816:12345-0@lo:101: 00010000:00010000:0.0:1782727251.398712:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727251.398727:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef40030a00/0x9832bf6cd8a42c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42c82 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.398765:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef40030a00/0x9832bf6cd8a42c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c82 expref: 13 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.398776:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef40030a00/0x9832bf6cd8a42c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c82 expref: 13 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727251.398787:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef40030a00, rc 0) 00000100:00100000:0.0:1782727251.402040:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912434816:12345-0@lo:101: Request processed in 3328us (3445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727251.402078:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782727251.402362:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434816:0@lo:101: 00010000:00010000:1.0:1782727251.402399:0:6932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.402414:0:6932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727251.402575:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434944:0@lo:501: 00000100:00100000:1.0:1782727251.403652:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727251.403716:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6da903c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727251.404090:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912434944 00000100:00100000:0.0:1782727251.404101:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912434944 00000100:00100000:0.0:1782727251.404168:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782727251.404180:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912434944:12345-0@lo:501: 00000100:00100000:0.0:1782727251.404368:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912434944:12345-0@lo:501: Request processed in 188us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727251.404376:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782727251.404592:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912434944:0@lo:501: 00000100:00100000:1.0:1782727251.404662:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912435072:0@lo:503: 00000100:00100000:1.0:1782727251.404721:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727251.404760:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6da903c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727251.404913:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912435072 00000100:00100000:0.0:1782727251.404920:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912435072 00000100:00100000:0.0:1782727251.404982:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782727251.404996:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912435072:12345-0@lo:503: 00000100:00100000:0.0:1782727251.405098:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912435072:12345-0@lo:503: Request processed in 103us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727251.405105:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782727251.405233:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912435072:0@lo:503: 00000040:00080000:2.0:1782727251.405590:0:6932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782727251.405686:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912435200:0@lo:502: 00000100:00100000:2.0:1782727251.405740:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727251.405780:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727251.405853:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912435200 00000100:00100000:3.0:1782727251.405859:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912435200 00000100:00100000:3.0:1782727251.405899:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727251.405908:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912435200:12345-0@lo:502: 00000100:00100000:3.0:1782727251.406046:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912435200:12345-0@lo:502: Request processed in 140us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727251.406053:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782727251.408071:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912435200:0@lo:502: 00000040:00080000:2.0:1782727251.408415:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782727251.408453:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782727251.408466:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782727251.408477:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782727251.408488:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782727251.408501:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782727251.408514:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782727251.408525:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782727251.408536:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782727251.408569:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782727251.408584:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782727251.408596:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782727251.408610:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782727251.408623:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782727251.408635:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782727251.408646:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782727251.408659:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782727251.408673:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782727251.408686:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782727251.408699:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782727251.408712:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782727251.408724:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782727251.408737:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782727251.408763:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782727251.408779:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782727251.408805:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1782727251.409441:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1782727251.409460:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1782727251.409524:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912435328:0@lo:502: 00000100:00100000:2.0:1782727251.409722:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727251.409841:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727251.410114:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912435328 00000100:00100000:3.0:1782727251.410126:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912435328 00000100:00100000:2.0:1782727251.410276:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782727251.410287:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912435328:12345-0@lo:502: 00000100:00100000:2.0:1782727251.410458:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912435328:12345-0@lo:502: Request processed in 172us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727251.410468:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782727251.410568:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912435328:0@lo:502: 00000040:00080000:3.0:1782727251.410658:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782727251.410672:0:6932:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1782727251.411311:0:6961:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782727251.411334:0:6961:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cef7510cd70) 00000020:00000080:3.0:1782727251.411359:0:6961:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1782727251.411583:0:6961:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cef46963800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782727251.411589:0:6961:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cef46963800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782727251.411592:0:6961:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8cef46963800 3 00010000:00080000:3.0:1782727251.411632:0:6961:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cef7782e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.123@tcp at head 00010000:00010000:3.0:1782727251.416305:0:6961:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1782727251.416447:0:6961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1782727251.416500:0:6961:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782727251.416518:0:6961:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9832bf6cd8a42c97 00000100:00080000:3.0:1782727251.416531:0:6961:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782727251.416539:0:6961:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cef7782e000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1782727251.416584:0:6961:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cef6c9af800 x1869324912435456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782727251.416626:0:6961:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782727251.419867:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3443:1869324912435456:0@lo:38: 00000100:00100000:1.0:1782727251.420002:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727251.420153:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912435584:0@lo:400: 00000100:00100000:1.0:1782727251.420182:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727251.420224:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912435456 00000100:00100000:1.0:1782727251.420233:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912435456 00000100:00100000:1.0:1782727251.420269:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912435584 00000100:00100000:1.0:1782727251.420272:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912435584 00000100:00100000:1.0:1782727251.420305:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782727251.420317:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912435584:12345-0@lo:400: 00000100:00100000:1.0:1782727251.420378:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912435584:12345-0@lo:400: Request processed in 63us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727251.420386:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782727251.420404:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782727251.420408:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3443:x1869324912435456:12345-0@lo:38: 00010000:00080000:1.0:1782727251.420434:0:5953:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:1.0:1782727251.420474:0:5953:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9832bf6cd8a42c9e 00000004:00100000:1.0:1782727251.420502:0:5953:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782727251.420546:0:5953:0:(import.c:65:import_set_state_nolock()) ffff8cef7cfd8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727251.420585:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869324912435456:12345-0@lo:38: Request processed in 175us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727251.420592:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782727251.422514:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cef6d8f8700 x1869324912435584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727251.422539:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912435584:0@lo:400: 00010000:00080000:1.0:1782727251.422613:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cef6c9af800 x1869324912435456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727251.424052:0:3443:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782727251.424065:0:3443:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1782727251.424078:0:3443:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782727251.424085:0:3443:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782727251.424090:0:3443:0:(import.c:65:import_set_state_nolock()) ffff8cef7782e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782727251.424102:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3443:1869324912435456:0@lo:38: 00000040:00080000:3.0:1782727251.424989:0:6961:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1782727251.426524:0:6932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1782727251.426572:0:6932:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782727251.426599:0:6932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.426615:0:6932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782727251.426696:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782727251.426699:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782727251.426700:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782727251.426702:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782727251.426703:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782727251.426704:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782727251.426706:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782727251.426707:0:6932:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782727251.426709:0:6932:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782727251.426711:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782727251.426712:0:6932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782727251.426718:0:6932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1782727251.426720:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782727251.426722:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782727251.426723:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782727251.426724:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782727251.426725:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782727251.426732:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782727251.426733:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782727251.426734:0:6932:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782727251.426734:0:6932:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782727251.426735:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782727251.426736:0:6932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782727251.426778:0:6932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782727251.426804:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912435712:0@lo:253: 00000100:00100000:2.0:1782727251.427017:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727251.427072:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa300 going to sleep for 11 seconds 00000100:00100000:1.0:1782727251.427204:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912435712 00000100:00100000:1.0:1782727251.427213:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912435712 00000100:00100000:1.0:1782727251.427276:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782727251.427286:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912435712:12345-0@lo:253: 20000000:01000000:1.0:1782727251.427548:0:5947:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782727251.427568:0:5947:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782727251.434679:0:5947:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782727251.434736:0:5947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1782727251.435126:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:6932:x1869324912435712:12345-0@lo:253: Request processed in 7833us (8101us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727251.435142:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782727251.435346:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:6932:1869324912435712:0@lo:253: 10000000:01000000:3.0:1782727251.435367:0:6932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782727251.435371:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782727251.435374:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782727251.435375:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727251.435376:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727251.435377:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727251.435385:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727251.435387:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727251.435389:0:6932:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727251.435391:0:6932:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727251.435393:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727251.435394:0:6932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782727251.435417:0:6932:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1782727251.436454:0:5968:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782727251.436463:0:5968:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782727251.436496:0:5968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.436516:0:5968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42bfd expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.436525:0:5968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.436575:0:5968:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42bfd expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.436593:0:5968:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42c04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bfd expref: 12 pid: 5947 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727251.436611:0:5968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ac000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869324912435840:0@lo:104: 00000100:00100000:2.0:1782727251.436779:0:5968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727251.436840:0:5968:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727251.441667:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912435840 00000100:00100000:1.0:1782727251.441689:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912435840 00000100:00100000:1.0:1782727251.441778:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727251.441791:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:5968:x1869324912435840:12345-0@lo:104: 00010000:00010000:1.0:1782727251.441822:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef41524800/0x9832bf6cd8a42bfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.441979:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727251.441986:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:5968:x1869324912435840:12345-0@lo:104: Request processed in 199us (5207us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727251.441993:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727251.442052:0:5968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ac000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869324912435840:0@lo:104: 00010000:00010000:1.0:1782727251.442086:0:5968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.442179:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727251.442187:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef41524800/0x9832bf6cd8a42bfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.442217:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41524800 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:2.0:1782727251.442222:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef41524800/0x9832bf6cd8a42bfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.442231:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef41524800/0x9832bf6cd8a42bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727251.442238:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef41524800/0x9832bf6cd8a42bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727251.442245:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727251.442301:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef41524800/0x9832bf6cd8a42bfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.442308:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727251.442328:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef41524800/0x9832bf6cd8a42bfd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.442335:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef41524800/0x9832bf6cd8a42bfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.442358:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727251.442360:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727251.442361:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727251.442783:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912435968:0@lo:103: 00000100:00100000:1.0:1782727251.442853:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727251.443387:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912435968 00000100:00100000:2.0:1782727251.443394:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912435968 00010000:00010000:2.0:1782727251.443424:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42c04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bfd expref: 13 pid: 5947 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727251.443454:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727251.443471:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c966850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+13:3445:x1869324912435968:12345-0@lo:103: 00010000:00010000:2.0:1782727251.443484:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727251.443490:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42c04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bfd expref: 13 pid: 5947 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443502:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42bfd expref: 13 pid: 5947 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443521:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42c04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42bfd expref: 13 pid: 5947 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443539:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443548:0:5936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782727251.443566:0:5936:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007653525s 00010000:00010000:2.0:1782727251.443570:0:5936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443577:0:5936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443585:0:5936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443592:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443599:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41486e00 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:2.0:1782727251.443609:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443617:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443643:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727251.443653:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727251.443698:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c966850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+12:3445:x1869324912435968:12345-0@lo:103: Request processed in 228us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727251.443705:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727251.444341:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912435968:0@lo:103: 00010000:00010000:1.0:1782727251.444373:0:5968:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.444381:0:5968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727251.444389:0:5968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42ca5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1782727251.445732:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1782727251.446157:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1782727251.446384:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1782727251.446535:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1782727251.451167:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1782727251.451596:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1782727251.460299:0:6932:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1782727251.474668:0:6932:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1782727251.474682:0:6932:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1782727251.474731:0:6932:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782727251.474880:0:6932:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782727251.474911:0:6932:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1782727251.475018:0:6932:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1782727251.477398:0:6932:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727251.477626:0:6932:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1782727251.695058:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727252.727756:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727252.770142:0:7015:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727252.770434:0:7015:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727253.759386:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727254.767168:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727255.792069:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727256.572009:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912436352:0@lo:400: 00000100:00100000:2.0:1782727256.572079:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727256.572141:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912436352 00000100:00100000:2.0:1782727256.572147:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912436352 00000100:00100000:2.0:1782727256.572765:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727256.572775:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912436352:12345-0@lo:400: 00000100:00100000:2.0:1782727256.572833:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912436352:12345-0@lo:400: Request processed in 60us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727256.572840:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782727256.572880:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef469ae680 x1869324912436352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727256.572902:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912436352:0@lo:400: 00000100:00100000:0.0:1782727256.573717:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912436224:0@lo:400: 00000100:00100000:0.0:1782727256.573759:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727256.573793:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727256.573799:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912436096:0@lo:400: 00000100:00100000:0.0:1782727256.573826:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782727256.574000:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727256.574204:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912436224 00000100:00100000:2.0:1782727256.574211:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912436224 00000100:00100000:2.0:1782727256.574255:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727256.574263:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912436224:12345-0@lo:400: 00000100:00100000:2.0:1782727256.574316:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912436224:12345-0@lo:400: Request processed in 53us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727256.574322:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727256.574344:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912436096 00000100:00100000:2.0:1782727256.574347:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912436096 00000100:00100000:2.0:1782727256.574372:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782727256.574378:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:3447:x1869324912436096:12345-0@lo:400: 00000100:00100000:2.0:1782727256.574410:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:3447:x1869324912436096:12345-0@lo:400: Request processed in 32us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727256.574417:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782727256.574457:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912436096:0@lo:400: 00010000:00080000:2.0:1782727256.574471:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef469ad180 x1869324912436224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727256.574482:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912436224:0@lo:400: 00010000:00010000:3.0:1782727256.818027:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727257.839088:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782727258.095671:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782727258.095677:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cef434e9800 from 21 10000000:01000000:0.0:1782727258.095682:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727258.095727:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727258.095749:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727258.095761:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727258.095785:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912436480:0@lo:101: 00000100:00100000:0.0:1782727258.095856:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727258.095913:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7532bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727258.096470:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912436480 00000100:00100000:1.0:1782727258.096482:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912436480 00000100:00100000:1.0:1782727258.096535:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782727258.096543:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+12:5949:x1869324912436480:12345-0@lo:101: 00010000:00010000:1.0:1782727258.096557:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727258.096570:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42cac expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.096593:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cac expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.096603:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cac expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.096612:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef82044600, rc 0) 00000100:00100000:1.0:1782727258.096671:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:5949:x1869324912436480:12345-0@lo:101: Request processed in 128us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727258.096678:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782727258.097107:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912436480:0@lo:101: 00010000:00010000:0.0:1782727258.097123:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727258.097132:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727258.097197:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912436608:0@lo:501: 00000100:00100000:0.0:1782727258.097858:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727258.097901:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7532bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727258.099911:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912436608 00000100:00100000:3.0:1782727258.099923:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912436608 00000100:00100000:3.0:1782727258.100101:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782727258.100113:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:5949:x1869324912436608:12345-0@lo:501: 00000100:00100000:3.0:1782727258.100319:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:5949:x1869324912436608:12345-0@lo:501: Request processed in 207us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727258.100327:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782727258.100392:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912436608:0@lo:501: 00000100:00100000:3.0:1782727258.100441:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912436736:0@lo:503: 00000100:00100000:3.0:1782727258.100493:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727258.100526:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576a900 going to sleep for 11 seconds 00000100:00100000:3.0:1782727258.100539:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912436736 00000100:00100000:3.0:1782727258.100543:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912436736 00000100:00100000:3.0:1782727258.100565:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727258.100572:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:5949:x1869324912436736:12345-0@lo:503: 00000100:00100000:3.0:1782727258.100666:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:5949:x1869324912436736:12345-0@lo:503: Request processed in 94us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727258.100673:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727258.100712:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912436736:0@lo:503: 00000100:00100000:3.0:1782727258.102029:0:7253:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:7253:1869324912436864:0@lo:502: 00000100:00100000:3.0:1782727258.102088:0:7253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727258.102119:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912436864 00000100:00100000:3.0:1782727258.102198:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912436864 00000100:00100000:3.0:1782727258.102235:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782727258.102242:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:7253:x1869324912436864:12345-0@lo:502: 00000100:00100000:3.0:1782727258.102475:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:7253:x1869324912436864:12345-0@lo:502: Request processed in 232us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727258.102483:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782727258.102531:0:7253:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576a480 going to sleep for 11 seconds 00000100:00100000:3.0:1782727258.102549:0:7253:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:7253:1869324912436864:0@lo:502: 00000100:00100000:3.0:1782727258.102589:0:7253:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:7253:1869324912436992:0@lo:502: 00000100:00100000:3.0:1782727258.102632:0:7253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727258.102653:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912436992 00000100:00100000:3.0:1782727258.102657:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912436992 00000100:00100000:3.0:1782727258.102676:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782727258.102690:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:7253:x1869324912436992:12345-0@lo:502: 00000100:00100000:2.0:1782727258.102796:0:7253:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576a480 going to sleep for 11 seconds 00000100:00100000:3.0:1782727258.104043:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:7253:x1869324912436992:12345-0@lo:502: Request processed in 1348us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727258.104055:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782727258.105964:0:7253:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:7253:1869324912436992:0@lo:502: 00000040:00080000:2.0:1782727258.106018:0:7253:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1782727258.106747:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1782727258.106775:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727258.106787:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727258.106799:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727258.106810:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782727258.106812:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8cef434e9800 from 4 10000000:01000000:3.0:1782727258.106815:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782727258.106855:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727258.106863:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727258.106871:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727258.106888:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912437120:0@lo:101: 00000100:00100000:3.0:1782727258.106967:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727258.107002:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576a300 going to sleep for 11 seconds 00000100:00100000:2.0:1782727258.108881:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912437120 00000100:00100000:2.0:1782727258.108894:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912437120 00000100:00100000:2.0:1782727258.109001:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782727258.109011:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:5949:x1869324912437120:12345-0@lo:101: 00010000:00010000:2.0:1782727258.109028:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727258.109049:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42cba expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727258.109078:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cba expref: 14 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727258.109090:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cba expref: 14 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727258.109098:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41486e00, rc 0) 00000100:00100000:2.0:1782727258.109172:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912437120:12345-0@lo:101: Request processed in 162us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727258.109179:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782727258.109321:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912437120:0@lo:101: 00010000:00010000:3.0:1782727258.109340:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727258.109356:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727258.109424:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912437248:0@lo:256: 00000100:00100000:3.0:1782727258.109462:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727258.109508:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576a300 going to sleep for 11 seconds 00000100:00100000:2.0:1782727258.109597:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912437248 00000100:00100000:2.0:1782727258.109603:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912437248 00000100:00100000:2.0:1782727258.109644:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782727258.109651:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912437248:12345-0@lo:256: 20000000:01000000:2.0:1782727258.109666:0:5946:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782727258.109683:0:5946:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782727258.109686:0:5946:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1782727258.109774:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912437248:12345-0@lo:256: Request processed in 123us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727258.109781:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782727258.109862:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912437248:0@lo:256: 10000000:01000000:1.0:1782727258.109905:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782727258.109913:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.109922:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727258.109950:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1782727258.109953:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1782727258.109956:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782727258.109979:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.109992:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.110001:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727258.110015:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912437376:0@lo:101: 00000100:00100000:1.0:1782727258.110042:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727258.110071:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef492fda80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727258.110163:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912437376 00000100:00100000:2.0:1782727258.110168:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912437376 00000100:00100000:2.0:1782727258.110199:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727258.110211:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912437376:12345-0@lo:101: 00010000:00010000:2.0:1782727258.110219:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727258.110229:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42cc8 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727258.110245:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cc8 expref: 15 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727258.110255:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cc8 expref: 15 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727258.110262:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41486c00, rc 0) 00000100:00100000:2.0:1782727258.110306:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912437376:12345-0@lo:101: Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727258.110312:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782727258.110359:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912437376:0@lo:101: 00010000:00010000:1.0:1782727258.110372:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.110380:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727258.110436:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912437504:0@lo:501: 00000100:00100000:1.0:1782727258.110464:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727258.110487:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef492fda80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727258.110590:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912437504 00000100:00100000:3.0:1782727258.110595:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912437504 00000100:00100000:3.0:1782727258.110633:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782727258.110640:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912437504:12345-0@lo:501: 00000100:00100000:3.0:1782727258.110756:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912437504:12345-0@lo:501: Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727258.110762:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782727258.111945:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912437504:0@lo:501: 00000100:00100000:1.0:1782727258.111999:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912437632:0@lo:503: 00000100:00100000:1.0:1782727258.112073:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727258.112112:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef492fda80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727258.112340:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912437632 00000100:00100000:3.0:1782727258.112347:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912437632 00000100:00100000:3.0:1782727258.112399:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782727258.112407:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912437632:12345-0@lo:503: 00000100:00100000:3.0:1782727258.112522:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912437632:12345-0@lo:503: Request processed in 115us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727258.112529:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782727258.112854:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912437632:0@lo:503: 00000100:00100000:2.0:1782727258.114244:0:7254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:7254:1869324912437760:0@lo:502: 00000100:00100000:2.0:1782727258.114330:0:7254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727258.114371:0:7254:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f000 going to sleep for 11 seconds 00000100:00100000:1.0:1782727258.115353:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912437760 00000100:00100000:1.0:1782727258.115368:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912437760 00000100:00100000:1.0:1782727258.115419:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782727258.115429:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:7254:x1869324912437760:12345-0@lo:502: 00000100:00100000:1.0:1782727258.115603:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:7254:x1869324912437760:12345-0@lo:502: Request processed in 175us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727258.115611:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782727258.119512:0:7254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:7254:1869324912437760:0@lo:502: 00000020:01000000:3.0:1782727258.119570:0:7254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782727258.119579:0:7254:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1782727258.119590:0:7254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727258.119592:0:7254:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782727258.119599:0:7254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782727258.119610:0:7254:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.123@tcp to nid 0x20000c0a8cc7b (192.168.204.123@tcp) 00000020:01000000:3.0:1782727258.119651:0:7254:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782727258.119655:0:7254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727258.119673:0:7254:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cef751099d0) 00000020:00000080:3.0:1782727258.119694:0:7254:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1782727258.119700:0:7254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782727258.119796:0:7254:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1782727258.119803:0:7254:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782727258.119810:0:7254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9832bf6cd8a42cdd 00010000:00080000:3.0:1782727258.119842:0:7254:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cef7782a800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:3.0:1782727258.120109:0:7254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1782727258.149167:0:7254:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782727258.149205:0:7254:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782727258.149585:0:7254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727258.149849:0:7254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727258.149985:0:7254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1782727258.150097:0:7254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1782727258.160581:0:7259:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782727258.160588:0:7259:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1782727258.164097:0:7254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782727258.164115:0:7254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782727258.164187:0:7254:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782727258.164373:0:7254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9832bf6cd8a42ce4 00000100:00080000:3.0:1782727258.164388:0:7254:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782727258.164395:0:7254:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cef7782a800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1782727258.164433:0:7254:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cef6c9af480 x1869324912437888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782727258.164465:0:7254:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1782727258.164542:0:7254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727258.164547:0:7254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727258.164549:0:7254:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1782727258.164553:0:7254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727258.164565:0:7254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727258.164566:0:7254:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782727258.164570:0:7254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782727258.164572:0:7254:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782727258.164604:0:7254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:7254:1869324912438016:0@lo:502: 00000100:00100000:3.0:1782727258.164714:0:7254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727258.164995:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912438144:0@lo:400: 00000100:00100000:2.0:1782727258.165035:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727258.165114:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727258.165121:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912438272:0@lo:400: 00000100:00100000:2.0:1782727258.165144:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727258.165171:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912438144 00000100:00100000:2.0:1782727258.165177:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912438144 00000100:00100000:3.0:1782727258.165468:0:7254:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576a900 going to sleep for 11 seconds 00000100:00100000:3.0:1782727258.165493:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912438016 00000100:00100000:3.0:1782727258.165497:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912438016 00000100:00100000:3.0:1782727258.165538:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782727258.165548:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+15:7254:x1869324912438016:12345-0@lo:502: 00000100:00100000:2.0:1782727258.165684:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912438272 00000100:00100000:2.0:1782727258.165688:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912438272 00000100:00100000:2.0:1782727258.165712:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727258.165718:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912438144:12345-0@lo:400: 00000100:00100000:1.0:1782727258.165862:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3443:1869324912437888:0@lo:8: 00000100:00100000:1.0:1782727258.165909:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727258.165970:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912438144:12345-0@lo:400: Request processed in 250us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727258.165977:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727258.165994:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727258.166001:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912438272:12345-0@lo:400: 00000100:00100000:1.0:1782727258.166010:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912437888 00000100:00100000:1.0:1782727258.166013:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912437888 00000100:00100000:2.0:1782727258.166035:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912438272:12345-0@lo:400: Request processed in 35us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727258.166041:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727258.166043:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727258.166049:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3443:x1869324912437888:12345-0@lo:8: 00010000:00080000:1.0:1782727258.166076:0:6938:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00010000:00080000:2.0:1782727258.166090:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef469ae680 x1869324912438272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727258.166105:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912438272:0@lo:400: 00000020:00000080:1.0:1782727258.166108:0:6938:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9832bf6cd8a42ceb 00010000:00080000:2.0:1782727258.166130:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef469ae300 x1869324912438144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727258.166139:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912438144:0@lo:400: 00002000:00100000:1.0:1782727258.166148:0:6938:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cef7cfda000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1782727258.166152:0:6938:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1782727258.166156:0:6938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1782727258.166231:0:6938:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1782727258.166443:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+15:7254:x1869324912438016:12345-0@lo:502: Request processed in 897us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727258.166452:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1782727258.166499:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1782727258.166509:0:6938:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782727258.166540:0:6938:0:(import.c:65:import_set_state_nolock()) ffff8cef7cfdd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727258.166591:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324912437888:12345-0@lo:8: Request processed in 541us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727258.166598:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782727258.166809:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6c9af480 x1869324912437888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782727268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727258.166818:0:3443:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1782727258.166990:0:7254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:7254:1869324912438016:0@lo:502: 00000020:01000000:2.0:1782727258.167031:0:7254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727258.167038:0:7254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727258.167040:0:7254:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782727258.167046:0:7254:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1782727258.167161:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1782727258.167184:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782727258.167202:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.167213:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727258.167225:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782727258.167227:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cef6cb64d70 from 1 10000000:01000000:1.0:1782727258.167230:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00080000:3.0:1782727258.167254:0:3443:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00010000:00010000:1.0:1782727258.167260:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.167277:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.167286:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727258.167305:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912438400:0@lo:101: 00000100:00100000:1.0:1782727258.167347:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782727258.167383:0:3443:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:1.0:1782727258.167389:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef787ca0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1782727258.167392:0:3443:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1782727258.167395:0:3443:0:(import.c:65:import_set_state_nolock()) ffff8cef7782a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782727258.167409:0:3443:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782727258.167415:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3443:1869324912437888:0@lo:8: 00000004:00080000:1.0:1782727258.167491:0:7259:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782727258.167562:0:7259:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 162343633129ns, next at 0ns, rc = 0 00080000:00080000:1.0:1782727258.167571:0:7259:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1782727258.167717:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912438400 00000100:00100000:2.0:1782727258.167792:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912438400 00000100:00100000:2.0:1782727258.167849:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782727258.167857:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912438400:12345-0@lo:101: 00010000:00010000:2.0:1782727258.167868:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727258.167880:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42cf2 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727258.167909:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cf2 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727258.167920:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cf2 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727258.167950:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41486400, rc 0) 00000100:00100000:2.0:1782727258.167993:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912438400:12345-0@lo:101: Request processed in 137us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727258.167999:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782727258.168384:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912438400:0@lo:101: 00010000:00010000:1.0:1782727258.168400:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727258.168411:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727258.168488:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912438528:0@lo:501: 00000100:00100000:1.0:1782727258.168518:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727258.168554:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef787ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727258.168579:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912438528 00000100:00100000:2.0:1782727258.168584:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912438528 00000100:00100000:2.0:1782727258.168626:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782727258.168634:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912438528:12345-0@lo:501: 00000100:00100000:2.0:1782727258.168698:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912438528:12345-0@lo:501: Request processed in 65us (179us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727258.168706:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782727258.168841:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912438528:0@lo:501: 10000000:01000000:2.0:1782727258.168871:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782727258.168877:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727258.168886:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782727258.178006:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1782727258.178593:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912438656:0@lo:13: 00000004:00080000:2.0:1782727258.179083:0:7262:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1782727258.179150:0:7262:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7262:1869324912438784:0@lo:7: 00000100:00100000:2.0:1782727258.179232:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727258.179415:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912438784 00000100:00100000:1.0:1782727258.179424:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912438784 00000100:00100000:3.0:1782727258.179458:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727258.179491:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727258.179500:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7262:x1869324912438784:12345-0@lo:7: 00000100:00080000:3.0:1782727258.179512:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727258.179529:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912438656 00000100:00100000:3.0:1782727258.179537:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912438656 00000100:00100000:2.0:1782727258.179563:0:7262:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f840 going to sleep for 11 seconds 00000100:00100000:3.0:1782727258.179574:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727258.179586:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3447:x1869324912438656:12345-0@lo:13: 00002000:00000024:3.0:1782727258.179606:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1782727258.179971:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3447:x1869324912438656:12345-0@lo:13: Request processed in 388us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727258.179979:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782727258.180089:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6c9af480 x1869324912438656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727258.180121:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912438656:0@lo:13: 00002000:00080000:0.0:1782727258.185456:0:6941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1782727258.185465:0:6941:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1782727258.185564:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7262:x1869324912438784:12345-0@lo:7: Request processed in 6060us (6330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727258.185578:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782727258.186910:0:7262:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef469ae300 x1869324912438784/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782727274 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727258.186961:0:7262:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7262:1869324912438784:0@lo:7: 00000004:00080000:2.0:1782727258.186982:0:7262:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1782727258.187237:0:7262:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7262:1869324912438912:0@lo:5: 00000100:00100000:2.0:1782727258.188113:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727258.188216:0:7262:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f840 going to sleep for 11 seconds 00000100:00100000:1.0:1782727258.190405:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912438912 00000100:00100000:1.0:1782727258.190420:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912438912 00000100:00100000:1.0:1782727258.190484:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782727258.190498:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7262:x1869324912438912:12345-0@lo:5: 00002000:00080000:1.0:1782727258.190533:0:6938:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782727258.190537:0:6938:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1782727258.199051:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1782727258.199075:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1782727258.199795:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7262:x1869324912438912:12345-0@lo:5: Request processed in 9298us (11683us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782727258.199807:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782727258.202571:0:7262:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef469ae300 x1869324912438912/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727274 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727258.202587:0:7262:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1782727258.202595:0:7262:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7262:1869324912438912:0@lo:5: 00000004:00080000:2.0:1782727258.202611:0:7262:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1782727258.203054:0:7262:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7262:1869324912439040:0@lo:700: 00000100:00100000:3.0:1782727258.203114:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727258.203201:0:7262:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576a480 going to sleep for 11 seconds 00000100:00100000:3.0:1782727258.205984:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912439040 00000100:00100000:3.0:1782727258.205997:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912439040 00000100:00100000:3.0:1782727258.206119:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727258.206331:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7262:x1869324912439040:12345-0@lo:700: 00000100:00100000:3.0:1782727258.206391:0:6947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6947:1869324912439168:0@lo:700: 00000100:00100000:3.0:1782727258.206455:0:6947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727258.206491:0:6947:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727258.206552:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912439168 00000100:00100000:2.0:1782727258.206556:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912439168 00000100:00100000:2.0:1782727258.206637:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727258.206646:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6947:x1869324912439168:12345-0@lo:700: 40000000:02000000:3.0:1782727258.225107:0:5959:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1782727258.238148:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6947:x1869324912439168:12345-0@lo:700: Request processed in 31493us (31681us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727258.238171:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782727258.238226:0:6947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6c9ad500 x1869324912439168/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782727274 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727258.238242:0:6947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6947:1869324912439168:0@lo:700: 40000000:02000000:3.0:1782727258.238255:0:6947:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1782727258.257479:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7262:x1869324912439040:12345-0@lo:700: Request processed in 51206us (54357us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727258.257502:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782727258.257599:0:7262:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6c9aea00 x1869324912439040/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782727274 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727258.257628:0:7262:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7262:1869324912439040:0@lo:700: 00000004:02000040:0.0:1782727258.265758:0:7262:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1782727258.275480:0:7262:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7262:1869324912439296:0@lo:5: 00000100:00100000:3.0:1782727258.275550:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727258.277788:0:7262:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727258.279101:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912439296 00000100:00100000:0.0:1782727258.279113:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912439296 00000100:00100000:0.0:1782727258.279183:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782727258.279193:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7262:x1869324912439296:12345-0@lo:5: 00002000:00080000:1.0:1782727258.295777:0:6941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1782727258.295799:0:6941:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1782727258.304384:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7262:x1869324912439296:12345-0@lo:5: Request processed in 25185us (28826us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782727258.304399:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782727258.304579:0:7262:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6c9ad500 x1869324912439296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727274 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727258.304597:0:7262:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7262:1869324912439296:0@lo:5: 00000004:00080000:2.0:1782727258.304636:0:7262:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1782727258.869220:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727258.914543:0:7309:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782727259.888794:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782727259.948703:0:7361:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727259.948873:0:7361:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1782727260.813183:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1782727260.911368:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727261.939060:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727262.929200:0:7475:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727262.929423:0:7475:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782727262.960310:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727263.216571:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727263.216765:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912439424:0@lo:13: 00000100:00100000:3.0:1782727263.216836:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727263.216967:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912439424 00000100:00100000:2.0:1782727263.216975:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912439424 00000100:00100000:2.0:1782727263.217040:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727263.217050:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912439424:12345-0@lo:13: 00002000:00000024:2.0:1782727263.217083:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727263.217132:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912439424:12345-0@lo:13: Request processed in 83us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727263.217140:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1782727263.219079:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727263.219145:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6c9aea00 x1869324912439424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727263.219158:0:3445:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782727263.219181:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912439424:0@lo:13: 00000100:00100000:2.0:1782727263.222051:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912439808:0@lo:400: 00000100:00100000:2.0:1782727263.222127:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727263.222167:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727263.222172:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912439680:0@lo:400: 00000100:00100000:2.0:1782727263.222195:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727263.222228:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912439808 00000100:00100000:2.0:1782727263.222236:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912439808 00000100:00100000:2.0:1782727263.222284:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912439680 00000100:00100000:2.0:1782727263.222288:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912439680 00000100:00100000:2.0:1782727263.222305:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727263.222315:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912439808:12345-0@lo:400: 00000100:00100000:2.0:1782727263.222383:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912439808:12345-0@lo:400: Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727263.222391:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727263.222421:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727263.222427:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912439680:12345-0@lo:400: 00000100:00100000:2.0:1782727263.222454:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912439680:12345-0@lo:400: Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727263.222460:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727263.222476:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727263.222485:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912439552:0@lo:400: 00000100:00100000:2.0:1782727263.222517:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727263.222567:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912439552 00000100:00100000:2.0:1782727263.222571:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912439552 00000100:00100000:2.0:1782727263.222610:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782727263.222617:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:3444:x1869324912439552:12345-0@lo:400: 00000100:00100000:2.0:1782727263.222651:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:3444:x1869324912439552:12345-0@lo:400: Request processed in 35us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727263.222658:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782727263.222704:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912439552:0@lo:400: 00010000:00080000:2.0:1782727263.222733:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6d9d0700 x1869324912439680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727263.222746:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912439680:0@lo:400: 00010000:00080000:2.0:1782727263.222758:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6d9d3480 x1869324912439808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727263.222766:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912439808:0@lo:400: 00000100:00080000:3.0:1782727263.223137:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:2.0:1782727263.775725:0:7523:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727263.775740:0:7523:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1782727263.985038:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727265.009862:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727266.032255:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727267.056065:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727268.080954:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727268.336310:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912439936:0@lo:13: 00000100:00100000:2.0:1782727268.336371:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727268.336573:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912439936 00000100:00100000:3.0:1782727268.336581:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912439936 00000100:00100000:3.0:1782727268.336646:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727268.336656:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912439936:12345-0@lo:13: 00002000:00000024:3.0:1782727268.336686:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:2.0:1782727268.336706:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727268.336735:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912439936:12345-0@lo:13: Request processed in 80us (362us total) trans 0 rc 0/0 00010000:00080000:2.0:1782727268.336757:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6c9aea00 x1869324912439936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727268.336759:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727268.336773:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912439936:0@lo:13: 00000100:00100000:3.0:1782727268.338019:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727268.338019:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912440192:0@lo:400: 00000100:00100000:3.0:1782727268.338031:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912440064:0@lo:400: 00000100:00100000:3.0:1782727268.339525:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727268.339672:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912440064 00000100:00100000:1.0:1782727268.339681:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912440064 00000100:00100000:1.0:1782727268.339778:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782727268.339788:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:3444:x1869324912440064:12345-0@lo:400: 00000100:00100000:1.0:1782727268.339855:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:3444:x1869324912440064:12345-0@lo:400: Request processed in 68us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727268.339873:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782727268.339976:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912440064:0@lo:400: 00000100:00100000:3.0:1782727268.340270:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912440320:0@lo:400: 00000100:00100000:3.0:1782727268.340307:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727268.340401:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912440320 00000100:00100000:0.0:1782727268.340427:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912440320 00000100:00100000:0.0:1782727268.340474:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727268.340481:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912440320:12345-0@lo:400: 00000100:00100000:0.0:1782727268.340521:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912440320:12345-0@lo:400: Request processed in 40us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727268.340527:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1782727268.340560:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef469ac000 x1869324912440320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727268.340572:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912440320:0@lo:400: 00000100:00080000:3.0:1782727268.340729:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727268.341215:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727268.341316:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912440192 00000100:00100000:0.0:1782727268.341321:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912440192 00000100:00100000:0.0:1782727268.341358:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782727268.341366:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912440192:12345-0@lo:400: 00000100:00100000:0.0:1782727268.341440:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912440192:12345-0@lo:400: Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727268.341462:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1782727268.341769:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef469af800 x1869324912440192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727268.341783:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912440192:0@lo:400: 00010000:00010000:1.0:1782727269.104327:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727270.128178:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727271.153634:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727272.175650:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727273.200665:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782727273.411392:0:8022:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782727273.411397:0:8022:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1782727273.411398:0:8022:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1782727273.411539:0:8022:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8cef77814800 00000020:01000004:2.0:1782727273.411556:0:8022:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1782727273.411570:0:8022:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782727273.411583:0:8022:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cef6cb633a0) 00000020:00000080:2.0:1782727273.411598:0:8022:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1782727273.458587:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727273.458614:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912440448:0@lo:13: 00000100:00100000:0.0:1782727273.458697:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727273.458784:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912440448 00000100:00100000:0.0:1782727273.458791:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912440448 00000100:00100000:0.0:1782727273.458849:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782727273.458858:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912440448:12345-0@lo:13: 00000100:00080000:2.0:1782727273.459074:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782727273.459185:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727273.459243:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912440448:12345-0@lo:13: Request processed in 384us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727273.459251:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782727273.459298:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6c9afb80 x1869324912440448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727273.459316:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912440448:0@lo:13: 00100000:10000000:3.0:1782727273.460421:0:8022:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1782727273.460477:0:8022:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00000100:00100000:1.0:1782727273.461123:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912440576:0@lo:400: 00000100:00100000:1.0:1782727273.461193:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.461252:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912440704:0@lo:400: 00000100:00100000:1.0:1782727273.461286:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.461313:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727273.461331:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912440832:0@lo:400: 00000100:00100000:1.0:1782727273.461363:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.461414:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912440576 00000100:00100000:1.0:1782727273.461421:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912440576 00000100:00100000:1.0:1782727273.461473:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782727273.461484:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef46633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:3445:x1869324912440576:12345-0@lo:400: 00000100:00100000:1.0:1782727273.461542:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef46633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:3445:x1869324912440576:12345-0@lo:400: Request processed in 60us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.461551:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782727273.461588:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912440704 00000100:00100000:1.0:1782727273.461593:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912440704 00000100:00100000:1.0:1782727273.461625:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912440832 00000100:00100000:1.0:1782727273.461629:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912440832 00000100:00100000:1.0:1782727273.461659:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727273.461677:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912440704:12345-0@lo:400: 00000100:00100000:1.0:1782727273.461724:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912440704:12345-0@lo:400: Request processed in 50us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.461732:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727273.461749:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727273.461757:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912440832:12345-0@lo:400: 00000100:00100000:1.0:1782727273.461789:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912440832:12345-0@lo:400: Request processed in 35us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.461795:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1782727273.461825:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727273.461852:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912440576:0@lo:400: 00010000:00080000:1.0:1782727273.462474:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6d8f9c00 x1869324912440832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727273.462487:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912440832:0@lo:400: 00010000:00080000:1.0:1782727273.462498:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6d8f8a80 x1869324912440704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727273.462506:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912440704:0@lo:400: 00080000:01000000:3.0:1782727273.478553:0:8022:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782727273.478747:0:8022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782727273.478759:0:8022:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782727273.478772:0:8022:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9832bf6cd8a42d07 00000020:01000004:3.0:1782727273.478780:0:8022:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1782727273.478802:0:8022:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782727273.478806:0:8022:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782727273.478814:0:8022:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782727273.478845:0:8022:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1782727273.478849:0:8022:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782727273.504333:0:8022:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782727273.504456:0:8022:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.123@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1782727273.504462:0:8022:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782727273.504464:0:8022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727273.504465:0:8022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727273.504466:0:8022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727273.504468:0:8022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727273.504470:0:8022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727273.504471:0:8022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727273.504473:0:8022:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727273.504475:0:8022:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727273.504476:0:8022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727273.504483:0:8022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727273.504487:0:8022:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1782727273.504489:0:8022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782727273.504490:0:8022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727273.504491:0:8022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727273.504492:0:8022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727273.504493:0:8022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727273.504495:0:8022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727273.504495:0:8022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727273.504496:0:8022:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727273.504497:0:8022:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727273.504498:0:8022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727273.504499:0:8022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727273.504526:0:8022:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782727273.504545:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912440960:0@lo:253: 00000100:00100000:3.0:1782727273.504614:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727273.504731:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef786bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727273.504822:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912440960 00000100:00100000:1.0:1782727273.504830:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912440960 00000100:00100000:1.0:1782727273.505144:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782727273.505155:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:8022:x1869324912440960:12345-0@lo:253: 20000000:01000000:1.0:1782727273.505188:0:5947:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1782727273.505192:0:5947:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1782727273.505197:0:5947:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1782727273.505200:0:5947:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1782727273.505498:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727273.505618:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1782727273.505632:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1782727273.505647:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1782727273.505651:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1782727273.505662:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1782727273.505675:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1782727273.505760:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1782727273.505775:0:5947:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:1.0:1782727273.505777:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:1.0:1782727273.505789:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1782727273.505794:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782727273.505807:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1782727273.505812:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:1.0:1782727273.505822:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1782727273.505827:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1782727273.505838:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1782727273.505852:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1782727273.507190:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1782727273.507213:0:5947:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:0.0:1782727273.507215:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:0.0:1782727273.507232:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1782727273.507241:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782727273.507254:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1782727273.507260:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:0.0:1782727273.507363:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1782727273.507373:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1782727273.507452:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1782727273.507472:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1782727273.507489:0:5947:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782727273.507497:0:5947:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782727273.507501:0:5947:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782727273.507547:0:5947:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782727273.507550:0:5947:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782727273.508188:0:8028:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1782727273.508216:0:8028:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1782727273.508235:0:8028:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1782727273.508554:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1782727273.508576:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1782727273.508592:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1782727273.508603:0:5947:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782727273.508605:0:5947:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727273.509171:0:8029:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727273.509193:0:8029:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727273.509208:0:8029:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1782727273.509376:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1782727273.509476:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1782727273.509493:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1782727273.509504:0:5947:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782727273.509506:0:5947:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782727273.509804:0:8030:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1782727273.510182:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1782727273.510203:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1782727273.510222:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1782727273.510234:0:5947:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1782727273.510244:0:5947:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727273.510601:0:8031:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727273.510625:0:8031:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727273.510635:0:8031:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1782727273.510769:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1782727273.510802:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1782727273.510817:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1782727273.510836:0:5947:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782727273.510854:0:5947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.511175:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c58 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.511185:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef40030a00/0x9832bf6cd8a42c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c82 expref: 16 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.511191:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cac expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.511198:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cc8 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.511205:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cf2 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.511212:0:5947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.511365:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42cf2 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.511448:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cf2 expref: 16 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.511464:0:5947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5947:1869324912441088:0@lo:104: 00000100:00100000:0.0:1782727273.511532:0:5947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727273.511619:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42cc8 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.511628:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cc8 expref: 16 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.511636:0:5947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5947:1869324912441216:0@lo:104: 00010000:00010000:0.0:1782727273.511660:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42cac expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.511668:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cac expref: 16 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.511676:0:5947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5947:1869324912441344:0@lo:104: 00010000:00010000:0.0:1782727273.511698:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef40030a00/0x9832bf6cd8a42c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42c82 expref: 16 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.511706:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef40030a00/0x9832bf6cd8a42c89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c82 expref: 16 pid: 5945 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.511727:0:5947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5947:1869324912441472:0@lo:104: 00010000:00010000:0.0:1782727273.511756:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42c58 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.511763:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42c5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c58 expref: 16 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.511770:0:5947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5947:1869324912441600:0@lo:104: 00000100:00100000:0.0:1782727273.511787:0:5947:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727273.511846:0:5934:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782727273.511865:0:5934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727273.512117:0:5934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727273.512214:0:5934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.512242:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912441088 00000100:00100000:1.0:1782727273.512250:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912441088 00000100:00100000:1.0:1782727273.512287:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912441216 00000100:00100000:1.0:1782727273.512290:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912441216 00000100:00100000:1.0:1782727273.512301:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912441344 00000100:00100000:1.0:1782727273.512303:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912441344 00000100:00100000:1.0:1782727273.512316:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727273.512345:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6098ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+5:5947:x1869324912441088:12345-0@lo:104: 00010000:00010000:1.0:1782727273.512357:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.512473:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727273.512479:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6098ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+5:5947:x1869324912441088:12345-0@lo:104: Request processed in 136us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.512487:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727273.512529:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727273.512536:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:5947:x1869324912441216:12345-0@lo:104: 00010000:00010000:1.0:1782727273.512544:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.512624:0:5947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5947:1869324912441088:0@lo:104: 00000100:00100000:0.0:1782727273.512633:0:5947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5947:1869324912441216:0@lo:104: 00010000:00010000:3.0:1782727273.512729:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727273.512736:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.512744:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82044c00 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:3.0:1782727273.512749:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.512758:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727273.512778:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727273.512785:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727273.512824:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.512832:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727273.512851:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.512859:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef82044c00/0x9832bf6cd8a42cf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42cf9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.512886:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727273.512890:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.512896:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82044400 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:3.0:1782727273.512899:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.512905:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727273.512911:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727273.512917:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727273.512999:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.513007:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727273.513013:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.513019:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42ccf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.513027:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727273.513028:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727273.513030:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727273.513225:0:5934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727273.513235:0:5934:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1782727273.513241:0:5934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1782727273.513523:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1782727273.513533:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:5947:x1869324912441216:12345-0@lo:104: Request processed in 996us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.513540:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727273.513557:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912441472 00000100:00100000:1.0:1782727273.513563:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912441472 00000100:00100000:1.0:1782727273.513579:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912441600 00000100:00100000:1.0:1782727273.513582:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912441600 00000100:00100000:1.0:1782727273.513593:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727273.513599:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+5:5947:x1869324912441344:12345-0@lo:104: 00010000:00010000:1.0:1782727273.513609:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.513660:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727273.513665:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+5:5947:x1869324912441344:12345-0@lo:104: Request processed in 66us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.513678:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727273.513689:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727273.513694:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:5947:x1869324912441472:12345-0@lo:104: 00010000:00010000:1.0:1782727273.513701:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.513730:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782727273.513735:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:5947:x1869324912441472:12345-0@lo:104: Request processed in 41us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.513741:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727273.513751:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727273.513757:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:5947:x1869324912441600:12345-0@lo:104: 00010000:00010000:1.0:1782727273.513765:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.513790:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782727273.513795:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:5947:x1869324912441600:12345-0@lo:104: Request processed in 39us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.513801:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727273.513822:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912441728:0@lo:103: 00000100:00100000:1.0:1782727273.513853:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727273.513974:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782727273.513980:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.513987:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef40030800 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727273.513991:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514000:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727273.514007:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727273.514012:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727273.514036:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514049:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727273.514066:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514072:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef40030800/0x9832bf6cd8a42cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42cb3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514083:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782727273.514086:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514091:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef40031800 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727273.514093:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514100:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727273.514106:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727273.514111:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727273.514126:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514132:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727273.514137:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514143:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef40031800/0x9832bf6cd8a42c82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c89 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514158:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727273.514161:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514167:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82045400 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727273.514170:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514176:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727273.514182:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727273.514186:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727273.514203:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514208:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727273.514213:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514218:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef82045400/0x9832bf6cd8a42c58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c5f expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514231:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727273.514233:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727273.514234:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727273.514334:0:5947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5947:1869324912441344:0@lo:104: 00000100:00100000:3.0:1782727273.514346:0:5947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5947:1869324912441472:0@lo:104: 00000100:00100000:3.0:1782727273.514353:0:5947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5947:1869324912441600:0@lo:104: 00010000:00010000:3.0:1782727273.514389:0:5947:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.514510:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727273.514528:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912441856:0@lo:103: 00000100:00100000:0.0:1782727273.514559:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727273.514592:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727273.514661:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912442240:0@lo:103: 00000100:00100000:1.0:1782727273.514688:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.514724:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912441728 00000100:00100000:1.0:1782727273.514728:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912441728 00010000:00010000:1.0:1782727273.514748:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cf2 expref: 17 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727273.514779:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912441856 00000100:00100000:1.0:1782727273.514782:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912441856 00010000:00010000:1.0:1782727273.514795:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cc8 expref: 18 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727273.514805:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912442240 00000100:00100000:1.0:1782727273.514807:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912442240 00010000:00010000:1.0:1782727273.514817:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42c5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c58 expref: 19 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727273.514829:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727273.514836:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+19:3444:x1869324912441728:12345-0@lo:103: 00010000:00010000:1.0:1782727273.514847:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727273.514852:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cf2 expref: 19 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.514860:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cf2 expref: 19 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.514872:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42cf2 expref: 19 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515036:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727273.515075:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+18:3444:x1869324912441728:12345-0@lo:103: Request processed in 239us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.515082:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727273.515096:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727273.515103:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+17:3445:x1869324912441856:12345-0@lo:103: 00010000:00010000:1.0:1782727273.515119:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727273.515124:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cc8 expref: 17 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515133:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cc8 expref: 17 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515144:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41486c00/0x9832bf6cd8a42ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42cc8 expref: 17 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515153:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727273.515182:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+16:3445:x1869324912441856:12345-0@lo:103: Request processed in 80us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.515188:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727273.515200:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727273.515205:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+15:3444:x1869324912442240:12345-0@lo:103: 00010000:00010000:1.0:1782727273.515213:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727273.515218:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42c5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c58 expref: 15 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515226:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c58 expref: 15 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515236:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42c5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42c58 expref: 15 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515245:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727273.515267:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+14:3444:x1869324912442240:12345-0@lo:103: Request processed in 62us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.515273:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727273.515300:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912441984:0@lo:103: 00000100:00100000:1.0:1782727273.515340:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.515360:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727273.515366:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912442112:0@lo:103: 00000100:00100000:0.0:1782727273.515480:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912442240:0@lo:103: 00000100:00100000:0.0:1782727273.515490:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912441728:0@lo:103: 00000100:00100000:1.0:1782727273.515538:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.515565:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912441984 00000100:00100000:1.0:1782727273.515569:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912441984 00010000:00010000:1.0:1782727273.515583:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cac expref: 14 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727273.515597:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912442112 00000100:00100000:1.0:1782727273.515599:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912442112 00010000:00010000:1.0:1782727273.515609:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef40030a00/0x9832bf6cd8a42c89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c82 expref: 15 pid: 5945 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727273.515620:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727273.515625:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c805432-a345-4b8b-859c-fa0b2938956c+15:3446:x1869324912441984:12345-0@lo:103: 00010000:00010000:1.0:1782727273.515634:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727273.515637:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cac expref: 15 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515647:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cac expref: 15 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515657:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef82044600/0x9832bf6cd8a42cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42cac expref: 15 pid: 5947 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515666:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727273.515734:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c805432-a345-4b8b-859c-fa0b2938956c+14:3446:x1869324912441984:12345-0@lo:103: Request processed in 109us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.515748:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727273.515759:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727273.515764:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c805432-a345-4b8b-859c-fa0b2938956c+13:3446:x1869324912442112:12345-0@lo:103: 00010000:00010000:1.0:1782727273.515771:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727273.515775:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef40030a00/0x9832bf6cd8a42c89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c82 expref: 13 pid: 5945 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515783:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef40030a00/0x9832bf6cd8a42c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c82 expref: 13 pid: 5945 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515792:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef40030a00/0x9832bf6cd8a42c89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42c82 expref: 13 pid: 5945 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515802:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515810:0:5938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515822:0:5938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515829:0:5938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515835:0:5938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515841:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515856:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82045600 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:1.0:1782727273.515860:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515867:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515972:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.515981:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727273.516006:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c805432-a345-4b8b-859c-fa0b2938956c+12:3446:x1869324912442112:12345-0@lo:103: Request processed in 242us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.516012:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727273.516044:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912441856:0@lo:103: 00010000:00010000:1.0:1782727273.516063:0:5947:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.516070:0:5947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.516077:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d0e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782727273.516091:0:5947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782727273.518650:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912441984:0@lo:103: 00000100:00100000:0.0:1782727273.518675:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912442112:0@lo:103: 00000100:00100000:3.0:1782727273.518887:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+11:8022:x1869324912440960:12345-0@lo:253: Request processed in 13732us (14270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727273.518899:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782727273.519164:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912440960:0@lo:253: 10000000:01000000:0.0:1782727273.519179:0:8022:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782727273.519183:0:8022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782727273.519185:0:8022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782727273.519187:0:8022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727273.519188:0:8022:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1782727273.519189:0:8022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727273.519191:0:8022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727273.519192:0:8022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727273.519194:0:8022:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782727273.519195:0:8022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727273.519196:0:8022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782727273.519214:0:8022:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cef77814800 from lustre-OST0001 10000000:01000000:0.0:1782727273.519247:0:8022:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1782727273.519250:0:8022:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782727273.519259:0:8022:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cef6cb64d70 local copy 10000000:01000000:0.0:1782727273.519264:0:8022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782727273.519303:0:8022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.519315:0:8022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.519353:0:8022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.519374:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912442368:0@lo:101: 00000100:00100000:0.0:1782727273.519488:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727273.519555:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727273.519590:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912442368 00000100:00100000:1.0:1782727273.519596:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912442368 00000100:00100000:1.0:1782727273.519667:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782727273.519676:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+11:8022:x1869324912442368:12345-0@lo:101: 00010000:00010000:1.0:1782727273.519695:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727273.519708:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42d15 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.519728:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d15 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.519737:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d15 expref: 12 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.519746:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef82044000, rc 0) 00000100:00100000:1.0:1782727273.519783:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912442368:12345-0@lo:101: Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.519790:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782727273.519845:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912442368:0@lo:101: 00010000:00010000:0.0:1782727273.519858:0:8022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.519867:0:8022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.520007:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912442496:0@lo:501: 00000100:00100000:0.0:1782727273.520034:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727273.520295:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727273.520356:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912442496 00000100:00100000:2.0:1782727273.520361:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912442496 00000100:00100000:3.0:1782727273.520553:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782727273.520561:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912442496:12345-0@lo:501: 00000100:00100000:3.0:1782727273.520632:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912442496:12345-0@lo:501: Request processed in 71us (597us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782727273.520639:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782727273.520690:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912442496:0@lo:501: 10000000:01000000:0.0:1782727273.520702:0:8022:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1782727273.520727:0:8022:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1782727273.520732:0:8022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.520739:0:8022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.520746:0:8022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.520779:0:8022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782727273.520805:0:8022:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cef77814800 10000000:01000000:0.0:1782727273.520810:0:8022:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782727273.520815:0:8022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782727273.520818:0:8022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782727273.520822:0:8022:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1782727273.520825:0:8022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782727273.520842:0:8022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.520849:0:8022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.520857:0:8022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.520881:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912442624:0@lo:101: 00000100:00100000:0.0:1782727273.520907:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727273.520964:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727273.520971:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.520978:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80272400 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:2.0:1782727273.520982:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.520990:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727273.520997:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727273.521003:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727273.521022:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.521029:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727273.521047:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.521054:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef80272400/0x9832bf6cd8a42d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9832bf6cd8a42d1c expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.521065:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727273.521067:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727273.521075:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727273.521336:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727273.521350:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727273.521360:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912442752:0@lo:103: 00000100:00100000:0.0:1782727273.521493:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.521547:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912442624 00000100:00100000:1.0:1782727273.521552:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912442624 00000100:00100000:1.0:1782727273.521576:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782727273.521584:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912442624:12345-0@lo:101: 00010000:00010000:1.0:1782727273.521593:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727273.521603:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef82045400/0x9832bf6cd8a42d2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42d23 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.521618:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef82045400/0x9832bf6cd8a42d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d23 expref: 13 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.521627:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef82045400/0x9832bf6cd8a42d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d23 expref: 13 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.521634:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef82045400, rc 0) 00000100:00100000:1.0:1782727273.521681:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912442624:12345-0@lo:101: Request processed in 98us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.521688:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782727273.521718:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912442752 00000100:00100000:1.0:1782727273.521722:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912442752 00000100:00100000:1.0:1782727273.521748:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727273.521754:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c805432-a345-4b8b-859c-fa0b2938956c+13:3444:x1869324912442752:12345-0@lo:103: 00010000:00010000:1.0:1782727273.521763:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727273.521774:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef82044000/0x9832bf6cd8a42d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9832bf6cd8a42d15 expref: 13 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.521784:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727273.521812:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c805432-a345-4b8b-859c-fa0b2938956c+12:3444:x1869324912442752:12345-0@lo:103: Request processed in 57us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.521818:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727273.521844:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912442752:0@lo:103: 00000100:00100000:0.0:1782727273.521920:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912442624:0@lo:101: 00010000:00010000:0.0:1782727273.521959:0:8022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.521968:0:8022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.522044:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912442880:0@lo:501: 00000100:00100000:0.0:1782727273.522071:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727273.522086:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727273.522205:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912442880 00000100:00100000:1.0:1782727273.522210:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912442880 00000100:00100000:1.0:1782727273.522228:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782727273.522235:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912442880:12345-0@lo:501: 00000100:00100000:1.0:1782727273.522342:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912442880:12345-0@lo:501: Request processed in 107us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.522349:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782727273.522531:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912442880:0@lo:501: 00000100:00100000:0.0:1782727273.522573:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443008:0@lo:503: 00000100:00100000:0.0:1782727273.522614:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727273.522642:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727273.522691:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912443008 00000100:00100000:1.0:1782727273.522696:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912443008 00000100:00100000:1.0:1782727273.522726:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782727273.522733:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912443008:12345-0@lo:503: 00000100:00100000:1.0:1782727273.522821:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912443008:12345-0@lo:503: Request processed in 87us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.522837:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782727273.523046:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443008:0@lo:503: 00000040:00080000:0.0:1782727273.523294:0:8022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782727273.523453:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443136:0@lo:502: 00000100:00100000:0.0:1782727273.523487:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727273.523514:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727273.523564:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912443136 00000100:00100000:1.0:1782727273.523568:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912443136 00000100:00100000:1.0:1782727273.523597:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782727273.523604:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912443136:12345-0@lo:502: 00000100:00100000:1.0:1782727273.523682:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912443136:12345-0@lo:502: Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.523688:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782727273.523784:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443136:0@lo:502: 00000040:00080000:0.0:1782727273.524161:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1782727273.524189:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1782727273.524202:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1782727273.524216:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1782727273.524230:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1782727273.524244:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1782727273.524265:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443264:0@lo:502: 00000100:00100000:0.0:1782727273.524301:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727273.524337:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727273.524469:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912443264 00000100:00100000:1.0:1782727273.524474:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912443264 00000100:00100000:0.0:1782727273.524632:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782727273.524640:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912443264:12345-0@lo:502: 00000100:00100000:0.0:1782727273.524753:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912443264:12345-0@lo:502: Request processed in 113us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727273.524761:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782727273.525245:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443264:0@lo:502: 00000040:00080000:1.0:1782727273.525309:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1782727273.525337:0:8022:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1782727273.526244:0:8033:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782727273.526253:0:8033:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1782727273.526259:0:8033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727273.526262:0:8033:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1782727273.526268:0:8033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782727273.526283:0:8033:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cef6db6b3a0) 00000020:00000080:1.0:1782727273.526331:0:8033:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782727273.526339:0:8033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782727273.526420:0:8033:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cef77814800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1782727273.526427:0:8033:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782727273.526433:0:8033:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9832bf6cd8a42d38 00010000:00010000:0.0:1782727273.531759:0:8033:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1782727273.532188:0:8033:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1782727273.535121:0:8033:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1782727273.535616:0:8033:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1782727273.540768:0:8033:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1782727273.541156:0:8033:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1782727273.547565:0:8033:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1782727273.548960:0:8033:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1782727273.548972:0:8033:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727273.548978:0:8033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727273.548980:0:8033:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1782727273.548990:0:8033:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727273.548994:0:8033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727273.548996:0:8033:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727273.548999:0:8033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727273.549000:0:8033:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782727273.549020:0:8033:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727273.549023:0:8033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727273.549025:0:8033:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782727273.549028:0:8033:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1782727273.549206:0:8022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1782727273.549238:0:8022:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782727273.549273:0:8022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.549285:0:8022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727273.549293:0:8022:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8cef77814800 from 1 10000000:01000000:2.0:1782727273.549295:0:8022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727273.549343:0:8022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.549352:0:8022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.549363:0:8022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727273.549394:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443392:0@lo:101: 00000100:00100000:2.0:1782727273.549461:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727273.549500:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef517e1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727273.549637:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912443392 00000100:00100000:3.0:1782727273.549654:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912443392 00000100:00100000:3.0:1782727273.549697:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782727273.549706:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+12:8022:x1869324912443392:12345-0@lo:101: 00010000:00010000:3.0:1782727273.549719:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727273.549747:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42d46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42d3f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.549770:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d3f expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.549782:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d3f expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.549789:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41525800, rc 0) 00000100:00100000:3.0:1782727273.549832:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912443392:12345-0@lo:101: Request processed in 127us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727273.549839:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782727273.549975:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443392:0@lo:101: 00010000:00010000:2.0:1782727273.549988:0:8022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.549997:0:8022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727273.550090:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443520:0@lo:501: 00000100:00100000:2.0:1782727273.550114:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727273.550137:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef517e1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727273.550194:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912443520 00000100:00100000:3.0:1782727273.550198:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912443520 00000100:00100000:3.0:1782727273.550221:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782727273.550227:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912443520:12345-0@lo:501: 00000100:00100000:3.0:1782727273.550332:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912443520:12345-0@lo:501: Request processed in 105us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727273.550339:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782727273.550366:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443520:0@lo:501: 00000100:00100000:3.0:1782727273.550402:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443648:0@lo:503: 00000100:00100000:3.0:1782727273.550436:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727273.550448:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef786bbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727273.550463:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912443648 00000100:00100000:3.0:1782727273.550466:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912443648 00000100:00100000:3.0:1782727273.550485:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782727273.550490:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912443648:12345-0@lo:503: 00000100:00100000:3.0:1782727273.550567:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912443648:12345-0@lo:503: Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727273.550573:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782727273.550617:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443648:0@lo:503: 00000040:00080000:3.0:1782727273.550816:0:8022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782727273.550879:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443776:0@lo:502: 00000100:00100000:3.0:1782727273.550914:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727273.550964:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef786bbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727273.550980:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912443776 00000100:00100000:3.0:1782727273.550985:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912443776 00000100:00100000:3.0:1782727273.551010:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782727273.551019:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912443776:12345-0@lo:502: 00000100:00100000:3.0:1782727273.551098:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912443776:12345-0@lo:502: Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727273.551105:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782727273.551148:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443776:0@lo:502: 00000040:00080000:3.0:1782727273.551351:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1782727273.551377:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1782727273.551398:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443904:0@lo:502: 00000100:00100000:3.0:1782727273.551438:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727273.551453:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f000 going to sleep for 11 seconds 00000100:00100000:3.0:1782727273.551467:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912443904 00000100:00100000:3.0:1782727273.551470:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912443904 00000100:00100000:3.0:1782727273.551498:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727273.551504:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912443904:12345-0@lo:502: 00000100:00100000:3.0:1782727273.551570:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912443904:12345-0@lo:502: Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727273.551576:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727273.551617:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912443904:0@lo:502: 00000040:00080000:3.0:1782727273.551661:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1782727273.551669:0:8022:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1782727273.552898:0:8036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727273.552909:0:8036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727273.552911:0:8036:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782727273.552919:0:8036:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cef77814800 00000020:00000080:2.0:1782727273.552922:0:8036:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782727273.552968:0:8036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727273.552973:0:8036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727273.552975:0:8036:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782727273.552978:0:8036:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1782727273.553133:0:8022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782727273.553157:0:8022:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727273.553176:0:8022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.553189:0:8022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727273.553243:0:8022:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782727273.553259:0:8022:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cef77814800 10000000:01000000:1.0:1782727273.553263:0:8022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cef77814800 10000000:01000000:1.0:1782727273.553269:0:8022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727273.553274:0:8022:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cef77814800 from 1 10000000:01000000:1.0:1782727273.553277:0:8022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727273.553307:0:8022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.553325:0:8022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.553337:0:8022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727273.553355:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444032:0@lo:101: 00000100:00100000:1.0:1782727273.553495:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.553538:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef787caa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727273.553744:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912444032 00000100:00100000:2.0:1782727273.553750:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912444032 00000100:00100000:2.0:1782727273.553800:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782727273.553810:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+13:8022:x1869324912444032:12345-0@lo:101: 00010000:00010000:2.0:1782727273.553821:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727273.553833:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42d54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42d4d expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.553853:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d4d expref: 14 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.553862:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d4d expref: 14 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.553870:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41486400, rc 0) 00000100:00100000:2.0:1782727273.553917:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444032:12345-0@lo:101: Request processed in 108us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727273.553960:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782727273.554089:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444032:0@lo:101: 00010000:00010000:1.0:1782727273.554102:0:8022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.554111:0:8022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727273.554196:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444160:0@lo:501: 00000100:00100000:1.0:1782727273.554222:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.556455:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef787caa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727273.558050:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912444160 00000100:00100000:2.0:1782727273.558061:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912444160 00000100:00100000:2.0:1782727273.558164:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782727273.558175:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444160:12345-0@lo:501: 00000100:00100000:2.0:1782727273.558361:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444160:12345-0@lo:501: Request processed in 188us (4137us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727273.558369:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782727273.558575:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444160:0@lo:501: 00000100:00100000:1.0:1782727273.558628:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444288:0@lo:503: 00000100:00100000:1.0:1782727273.558680:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.559517:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef787caa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727273.559586:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912444288 00000100:00100000:2.0:1782727273.559592:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912444288 00000100:00100000:2.0:1782727273.559616:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782727273.559623:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444288:12345-0@lo:503: 00000100:00100000:2.0:1782727273.559727:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444288:12345-0@lo:503: Request processed in 103us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727273.559734:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782727273.559809:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444288:0@lo:503: 00000040:00080000:1.0:1782727273.560141:0:8022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782727273.560217:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444416:0@lo:502: 00000100:00100000:1.0:1782727273.560258:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.560277:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef787ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727273.560352:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912444416 00000100:00100000:2.0:1782727273.560357:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912444416 00000100:00100000:2.0:1782727273.560387:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782727273.560396:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444416:12345-0@lo:502: 00000100:00100000:2.0:1782727273.560481:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444416:12345-0@lo:502: Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727273.560488:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782727273.560618:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444416:0@lo:502: 00000040:00080000:1.0:1782727273.560790:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1782727273.560816:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1782727273.560830:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1782727273.560843:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1782727273.560867:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1782727273.560882:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1782727273.560894:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1782727273.560907:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1782727273.560919:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1782727273.560963:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1782727273.560979:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1782727273.560992:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1782727273.561007:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1782727273.561021:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1782727273.561036:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1782727273.561065:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1782727273.561080:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1782727273.561091:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1782727273.561105:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1782727273.561118:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1782727273.561130:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1782727273.561143:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1782727273.561155:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1782727273.561168:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1782727273.561182:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1782727273.561195:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1782727273.561207:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1782727273.561222:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1782727273.561236:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1782727273.561258:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1782727273.561274:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1782727273.561301:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1782727273.561330:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1782727273.561348:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1782727273.561361:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1782727273.561374:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1782727273.561402:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1782727273.561434:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444544:0@lo:502: 00000100:00100000:1.0:1782727273.561475:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.561495:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef787ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727273.561610:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912444544 00000100:00100000:2.0:1782727273.561615:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912444544 00000100:00100000:2.0:1782727273.561639:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782727273.561645:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444544:12345-0@lo:502: 00000100:00100000:2.0:1782727273.561735:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444544:12345-0@lo:502: Request processed in 89us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727273.561741:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782727273.561901:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444544:0@lo:502: 00000040:00080000:1.0:1782727273.561992:0:8022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1782727273.562000:0:8022:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1782727273.562430:0:8038:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782727273.562444:0:8038:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cef6db68000) 00000020:00000080:1.0:1782727273.562462:0:8038:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1782727273.562623:0:8038:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cef77814800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782727273.562628:0:8038:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cef77814800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782727273.562631:0:8038:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8cef77814800 3 00010000:00080000:1.0:1782727273.562658:0:8038:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cef6dabb800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.123@tcp at head 00010000:00010000:1.0:1782727273.564847:0:8038:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1782727273.564993:0:8038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782727273.565055:0:8038:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782727273.565079:0:8038:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9832bf6cd8a42d62 00000100:00080000:1.0:1782727273.565090:0:8038:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782727273.565097:0:8038:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cef6dabb800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:1.0:1782727273.565132:0:8038:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cef6d8fbb80 x1869324912444672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782727273.565163:0:8038:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782727273.565472:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324912444672:0@lo:38: 00000100:00100000:2.0:1782727273.565539:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782727273.567134:0:8039:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8cef6d9d3800 x1869324912444800/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727273.567198:0:8039:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef50059840 going to sleep for 0 seconds 00000100:00100000:3.0:1782727273.569027:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912444672 00000100:00100000:3.0:1782727273.569038:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912444672 00000100:00100000:3.0:1782727273.569074:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727273.569082:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3443:x1869324912444672:12345-0@lo:38: 00010000:00080000:3.0:1782727273.569106:0:5953:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1782727273.569142:0:5953:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9832bf6cd8a42d69 00000004:00100000:3.0:1782727273.569167:0:5953:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782727273.569199:0:5953:0:(import.c:65:import_set_state_nolock()) ffff8cef7e0b9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782727273.569272:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324912444672:12345-0@lo:38: Request processed in 190us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727273.569279:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782727273.569334:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6d8fbb80 x1869324912444672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727273.569347:0:3443:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782727273.569355:0:3443:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1782727273.569371:0:3443:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782727273.569376:0:3443:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782727273.569379:0:3443:0:(import.c:65:import_set_state_nolock()) ffff8cef6dabb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1782727273.569392:0:3443:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f7d47e15): req@ffff8cef6d9d3800 x1869324912444800/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727273.569411:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324912444672:0@lo:38: 00000040:00080000:1.0:1782727273.569547:0:8038:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1782727273.569715:0:8022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1782727273.569744:0:8022:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727273.569792:0:8022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727273.569804:0:8022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782727273.569845:0:8022:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782727273.569847:0:8022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727273.569849:0:8022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727273.569850:0:8022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727273.569851:0:8022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727273.569853:0:8022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727273.569855:0:8022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727273.569857:0:8022:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727273.569858:0:8022:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727273.569859:0:8022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727273.569861:0:8022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782727273.569864:0:8022:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1782727273.569866:0:8022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782727273.569868:0:8022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727273.569869:0:8022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727273.569870:0:8022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727273.569871:0:8022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727273.569872:0:8022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727273.569873:0:8022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727273.569874:0:8022:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727273.569875:0:8022:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727273.569876:0:8022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727273.569878:0:8022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782727273.569895:0:8022:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782727273.569920:0:8022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444928:0@lo:253: 00000100:00100000:3.0:1782727273.569977:0:8022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727273.570001:0:8022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f000 going to sleep for 11 seconds 00000100:00100000:0.0:1782727273.570822:0:8039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727273.570854:0:8039:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef50059840 going to sleep for 11 seconds 00000100:00100000:2.0:1782727273.570923:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912444928 00000100:00100000:2.0:1782727273.570952:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912444928 00000100:00100000:2.0:1782727273.570994:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782727273.571003:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444928:12345-0@lo:253: 20000000:01000000:2.0:1782727273.571026:0:5946:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1782727273.571040:0:5946:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1782727273.571378:0:5963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912444800 00000100:00100000:1.0:1782727273.571382:0:5963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912444800 00000100:00100000:1.0:1782727273.571428:0:5963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727273.571434:0:5963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8039:x1869324912444800:12345-0@lo:901: 00000100:00100000:1.0:1782727273.571517:0:5963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8039:x1869324912444800:12345-0@lo:901: Request processed in 82us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727273.571535:0:5963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782727273.571901:0:8039:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cef6d9d3800 x1869324912444800/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782727289 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727273.571915:0:8039:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d3800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8039:1869324912444800:0@lo:901: 00000100:00080000:2.0:1782727273.572067:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1782727273.579789:0:5946:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782727273.579839:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1782727273.579970:0:5968:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782727273.579979:0:5968:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782727273.580001:0:5968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.580019:0:5968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42cba expref: 14 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.580029:0:5968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.580079:0:5968:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42cba expref: 14 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727273.580093:0:5968:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cba expref: 14 pid: 5945 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727273.580106:0:5968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869324912445056:0@lo:104: 00000100:00100000:3.0:1782727273.580200:0:8022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c805432-a345-4b8b-859c-fa0b2938956c:8022:1869324912444928:0@lo:253: 10000000:01000000:3.0:1782727273.580213:0:8022:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782727273.580217:0:8022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782727273.580219:0:8022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727273.580220:0:8022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727273.580221:0:8022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727273.580223:0:8022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727273.580224:0:8022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727273.580226:0:8022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727273.580227:0:8022:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727273.580229:0:8022:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727273.580230:0:8022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727273.580232:0:8022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1782727273.580261:0:5968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727273.580305:0:5968:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef787ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1782727273.580369:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912445056 00000100:00100000:2.0:1782727273.580376:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912445056 00000100:00100000:2.0:1782727273.580430:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782727273.580437:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:5968:x1869324912445056:12345-0@lo:104: 00010000:00010000:2.0:1782727273.580448:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727273.580483:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727273.580487:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:5968:x1869324912445056:12345-0@lo:104: Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727273.580491:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727273.580558:0:5968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869324912445056:0@lo:104: 00010000:00010000:1.0:1782727273.580573:0:5968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.580616:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:8022:x1869324912444928:12345-0@lo:253: Request processed in 9613us (10636us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727273.580624:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:0.0:1782727273.580658:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727273.580664:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.580672:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41524e00 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727273.580676:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.580698:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727273.580705:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727273.580711:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727273.580775:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.580782:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727273.580806:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.580812:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef41524e00/0x9832bf6cd8a42cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42cc1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.580823:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727273.580824:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727273.580825:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727273.580831:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727273.580839:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912445184:0@lo:103: 00000100:00100000:0.0:1782727273.580863:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727273.580886:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912445184 00000100:00100000:0.0:1782727273.580888:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912445184 00010000:00010000:0.0:1782727273.580901:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cba expref: 14 pid: 5945 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727273.580917:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727273.580920:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c967c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+14:3447:x1869324912445184:12345-0@lo:103: 00010000:00010000:0.0:1782727273.580952:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727273.580956:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cba expref: 14 pid: 5945 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.580965:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42cba expref: 14 pid: 5945 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.580978:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41486e00/0x9832bf6cd8a42cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42cba expref: 14 pid: 5945 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.580990:0:6955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.580998:0:6955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782727273.581010:0:6955:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007653525s 00010000:00010000:0.0:1782727273.581013:0:6955:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.581020:0:6955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.581024:0:6955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.581028:0:6955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.581031:0:6955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82045600 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:0.0:1782727273.581033:0:6955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.581043:0:6955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.581053:0:6955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.581061:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727273.581088:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c967c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+13:3447:x1869324912445184:12345-0@lo:103: Request processed in 166us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727273.581095:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000020:02000000:3.0:1782727273.581137:0:8022:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1782727273.581148:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912445184:0@lo:103: 00010000:00010000:0.0:1782727273.581163:0:5968:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.581169:0:5968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727273.581175:0:5968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef82045600/0x9832bf6cd8a42d70 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1782727273.588290:0:8022:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1782727273.588538:0:8022:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1782727273.588892:0:8022:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1782727273.589072:0:8022:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1782727273.589504:0:8022:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1782727273.589697:0:8022:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1782727273.591192:0:8022:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1782727273.601546:0:8022:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1782727273.601556:0:8022:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1782727273.601597:0:8022:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782727273.601648:0:8022:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782727273.601666:0:8022:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1782727273.601707:0:8022:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1782727273.606127:0:8022:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727273.606413:0:8022:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1782727274.233358:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782727274.577770:0:8092:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727274.578816:0:8092:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782727275.248209:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727276.274425:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727277.295262:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727278.320120:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727278.578535:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912445696:0@lo:400: 00000100:00100000:2.0:1782727278.578645:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727278.578719:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782727278.578725:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912445312:0@lo:400: 00000100:00100000:2.0:1782727278.578759:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727278.578792:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912445824:0@lo:400: 00000100:00100000:2.0:1782727278.578818:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727278.578878:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912445312 00000100:00100000:2.0:1782727278.578887:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912445312 00000100:00100000:2.0:1782727278.578970:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782727278.578980:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:3446:x1869324912445312:12345-0@lo:400: 00000100:00100000:2.0:1782727278.579039:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:3446:x1869324912445312:12345-0@lo:400: Request processed in 60us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727278.579048:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782727278.579107:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912445312:0@lo:400: 00000100:00100000:1.0:1782727278.579553:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912445440:0@lo:400: 00000100:00100000:1.0:1782727278.579593:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727278.579650:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727278.579657:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912445568:0@lo:400: 00000100:00100000:1.0:1782727278.579681:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727278.579715:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912445696 00000100:00100000:1.0:1782727278.579720:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912445696 00000100:00100000:1.0:1782727278.579768:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727278.579776:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912445696:12345-0@lo:400: 00000100:00100000:1.0:1782727278.579818:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912445696:12345-0@lo:400: Request processed in 43us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727278.579825:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727278.579844:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912445824 00000100:00100000:1.0:1782727278.579847:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912445824 00000100:00100000:1.0:1782727278.579866:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912445440 00000100:00100000:1.0:1782727278.579869:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912445440 00000100:00100000:1.0:1782727278.579879:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912445568 00000100:00100000:1.0:1782727278.579882:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912445568 00000100:00100000:1.0:1782727278.579894:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727278.579900:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912445824:12345-0@lo:400: 00000100:00100000:1.0:1782727278.579949:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912445824:12345-0@lo:400: Request processed in 49us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727278.579956:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727278.579967:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727278.579973:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912445440:12345-0@lo:400: 00000100:00100000:1.0:1782727278.580003:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912445440:12345-0@lo:400: Request processed in 30us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727278.580009:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727278.580018:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782727278.580023:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912445568:12345-0@lo:400: 00000100:00100000:1.0:1782727278.580055:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912445568:12345-0@lo:400: Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727278.580061:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1782727278.580082:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727278.580087:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782727278.580128:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6f100 x1869324912445568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727278.580141:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912445568:0@lo:400: 00010000:00080000:1.0:1782727278.580152:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef469ad180 x1869324912445440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727278.580161:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912445440:0@lo:400: 00010000:00080000:1.0:1782727278.580196:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6c700 x1869324912445824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727278.580203:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912445824:0@lo:400: 00010000:00080000:1.0:1782727278.580213:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6e680 x1869324912445696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727278.580232:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912445696:0@lo:400: 00000100:00100000:2.0:1782727278.582002:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727278.582026:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912445952:0@lo:13: 00000100:00100000:2.0:1782727278.582111:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727278.582159:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912445952 00000100:00100000:2.0:1782727278.582166:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912445952 00000100:00100000:2.0:1782727278.582215:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727278.582235:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912445952:12345-0@lo:13: 00002000:00000024:2.0:1782727278.582278:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727278.582342:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912445952:12345-0@lo:13: Request processed in 108us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727278.582349:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782727278.582394:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6f800 x1869324912445952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727278.582412:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912445952:0@lo:13: 10000000:01000000:2.0:1782727279.090555:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782727279.090567:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cef46963800 from 30 10000000:01000000:2.0:1782727279.090574:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727279.090655:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727279.090669:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727279.090684:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727279.090716:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446080:0@lo:101: 00000100:00100000:2.0:1782727279.090816:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727279.090896:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74900 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.091036:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912446080 00000100:00100000:1.0:1782727279.091046:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912446080 00000100:00100000:1.0:1782727279.091118:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782727279.091129:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+13:5949:x1869324912446080:12345-0@lo:101: 00010000:00010000:1.0:1782727279.091145:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727279.091161:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42d77 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.091221:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d77 expref: 14 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.091233:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d77 expref: 14 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.091243:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef82045200, rc 0) 00000100:00100000:1.0:1782727279.091297:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912446080:12345-0@lo:101: Request processed in 169us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.091304:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782727279.091484:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446080:0@lo:101: 00010000:00010000:3.0:1782727279.091504:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727279.091514:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727279.091601:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446208:0@lo:501: 00000100:00100000:3.0:1782727279.091632:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727279.091667:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727279.091767:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912446208 00000100:00100000:2.0:1782727279.091772:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912446208 00000100:00100000:2.0:1782727279.091811:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782727279.091819:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912446208:12345-0@lo:501: 00000100:00100000:2.0:1782727279.091981:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912446208:12345-0@lo:501: Request processed in 163us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727279.091989:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782727279.092030:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446208:0@lo:501: 00000100:00100000:2.0:1782727279.092060:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446336:0@lo:503: 00000100:00100000:2.0:1782727279.092225:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727279.092252:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727279.092302:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912446336 00000100:00100000:3.0:1782727279.092307:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912446336 00000100:00100000:3.0:1782727279.092339:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782727279.092345:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912446336:12345-0@lo:503: 00000100:00100000:3.0:1782727279.092432:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912446336:12345-0@lo:503: Request processed in 87us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.092439:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782727279.092531:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446336:0@lo:503: 00000100:00100000:2.0:1782727279.098430:0:8322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8322:1869324912446464:0@lo:502: 00000100:00100000:2.0:1782727279.098552:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727279.098627:0:8322:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.100745:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912446464 00000100:00100000:1.0:1782727279.100761:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912446464 00000100:00100000:1.0:1782727279.100843:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782727279.100855:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+14:8322:x1869324912446464:12345-0@lo:502: 00000100:00100000:1.0:1782727279.101782:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+14:8322:x1869324912446464:12345-0@lo:502: Request processed in 923us (3224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.101795:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782727279.101976:0:8322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8322:1869324912446464:0@lo:502: 00000100:00100000:2.0:1782727279.102070:0:8322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8322:1869324912446592:0@lo:502: 00000100:00100000:2.0:1782727279.102139:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727279.102175:0:8322:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.104345:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912446592 00000100:00100000:1.0:1782727279.104365:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912446592 00000100:00100000:1.0:1782727279.104441:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782727279.104453:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:8322:x1869324912446592:12345-0@lo:502: 00000100:00100000:1.0:1782727279.104659:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:8322:x1869324912446592:12345-0@lo:502: Request processed in 208us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.104668:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782727279.104999:0:8322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8322:1869324912446592:0@lo:502: 00000040:00080000:2.0:1782727279.105038:0:8322:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782727279.105488:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782727279.105514:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727279.105527:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.105547:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727279.105559:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1782727279.105562:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1782727279.105566:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782727279.105607:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.105616:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.105704:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727279.105727:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446720:0@lo:101: 00000100:00100000:1.0:1782727279.105781:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.105830:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef474f8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727279.106077:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912446720 00000100:00100000:2.0:1782727279.106784:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912446720 00000100:00100000:3.0:1782727279.107335:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782727279.107347:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912446720:12345-0@lo:101: 00010000:00010000:3.0:1782727279.107367:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727279.107390:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42d85 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727279.107421:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d85 expref: 15 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727279.107433:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d85 expref: 15 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727279.107443:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41525400, rc 0) 00000100:00100000:3.0:1782727279.107532:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912446720:12345-0@lo:101: Request processed in 186us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.107540:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782727279.108266:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446720:0@lo:101: 00010000:00010000:2.0:1782727279.108291:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727279.108302:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727279.108393:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446848:0@lo:501: 00000100:00100000:2.0:1782727279.108443:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727279.108487:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.108701:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912446848 00000100:00100000:1.0:1782727279.108707:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912446848 00000100:00100000:1.0:1782727279.108756:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782727279.108765:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912446848:12345-0@lo:501: 00000100:00100000:1.0:1782727279.108925:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912446848:12345-0@lo:501: Request processed in 161us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.108959:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782727279.109000:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446848:0@lo:501: 00000100:00100000:1.0:1782727279.109030:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446976:0@lo:503: 00000100:00100000:1.0:1782727279.114180:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.114277:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef474f8000 going to sleep for 11 seconds 00000100:00100000:3.0:1782727279.114438:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912446976 00000100:00100000:3.0:1782727279.114450:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912446976 00000100:00100000:3.0:1782727279.114522:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782727279.114532:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912446976:12345-0@lo:503: 00000100:00100000:3.0:1782727279.114719:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912446976:12345-0@lo:503: Request processed in 187us (5635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.114727:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782727279.115096:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912446976:0@lo:503: 00000100:00100000:2.0:1782727279.116922:0:8323:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8323:1869324912447104:0@lo:502: 00000100:00100000:2.0:1782727279.117057:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727279.117120:0:8323:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727279.117284:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912447104 00000100:00100000:3.0:1782727279.117293:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912447104 00000100:00100000:3.0:1782727279.117355:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782727279.117368:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+15:8323:x1869324912447104:12345-0@lo:502: 00000100:00100000:3.0:1782727279.117534:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+15:8323:x1869324912447104:12345-0@lo:502: Request processed in 167us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.117543:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782727279.120376:0:8323:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8323:1869324912447104:0@lo:502: 00000020:01000000:2.0:1782727279.120444:0:8323:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727279.120460:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727279.120463:0:8323:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782727279.120470:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782727279.120472:0:8323:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782727279.120519:0:8323:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8323:1869324912447232:0@lo:502: 00000100:00100000:2.0:1782727279.120616:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727279.120676:0:8323:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.120774:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912447232 00000100:00100000:1.0:1782727279.120782:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912447232 00000100:00100000:1.0:1782727279.120848:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782727279.120859:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+15:8323:x1869324912447232:12345-0@lo:502: 00000100:00100000:1.0:1782727279.121041:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+15:8323:x1869324912447232:12345-0@lo:502: Request processed in 183us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.121048:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782727279.121342:0:8323:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8323:1869324912447232:0@lo:502: 00000020:01000000:2.0:1782727279.121364:0:8323:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727279.121370:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727279.121373:0:8323:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782727279.121376:0:8323:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1782727279.121742:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1782727279.121772:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782727279.121785:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.121798:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727279.121811:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782727279.121814:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cef434e9800 from 30 10000000:01000000:1.0:1782727279.121818:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727279.121851:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.121860:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.121869:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727279.121899:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912447360:0@lo:101: 00000100:00100000:1.0:1782727279.121978:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.122004:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef474f8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727279.122168:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912447360 00000100:00100000:3.0:1782727279.122175:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912447360 00000100:00100000:3.0:1782727279.122228:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782727279.122238:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912447360:12345-0@lo:101: 00010000:00010000:3.0:1782727279.122250:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727279.122266:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42d9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42d93 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727279.122292:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d93 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727279.122303:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d93 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727279.122312:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41524400, rc 0) 00000100:00100000:3.0:1782727279.122361:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912447360:12345-0@lo:101: Request processed in 125us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.122368:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782727279.122480:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912447360:0@lo:101: 00010000:00010000:2.0:1782727279.122495:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727279.122504:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727279.122565:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912447488:0@lo:501: 00000100:00100000:2.0:1782727279.122594:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727279.122610:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.122710:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912447488 00000100:00100000:1.0:1782727279.122715:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912447488 00000100:00100000:1.0:1782727279.122748:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782727279.122755:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912447488:12345-0@lo:501: 00000100:00100000:1.0:1782727279.122887:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912447488:12345-0@lo:501: Request processed in 132us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.122893:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782727279.122922:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912447488:0@lo:501: 00000100:00100000:1.0:1782727279.122973:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912447616:0@lo:503: 00000100:00100000:1.0:1782727279.123009:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.123022:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.123033:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912447616 00000100:00100000:1.0:1782727279.123036:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912447616 00000100:00100000:1.0:1782727279.123052:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782727279.123058:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912447616:12345-0@lo:503: 00000100:00100000:1.0:1782727279.125390:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912447616:12345-0@lo:503: Request processed in 2316us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.125406:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782727279.125494:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912447616:0@lo:503: 00000100:00100000:2.0:1782727279.128446:0:8324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8324:1869324912447744:0@lo:502: 00000100:00100000:2.0:1782727279.128561:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727279.128613:0:8324:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74180 going to sleep for 11 seconds 00000100:00100000:3.0:1782727279.128749:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912447744 00000100:00100000:3.0:1782727279.128759:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912447744 00000100:00100000:3.0:1782727279.128820:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782727279.128831:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:8324:x1869324912447744:12345-0@lo:502: 00000100:00100000:3.0:1782727279.129013:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:8324:x1869324912447744:12345-0@lo:502: Request processed in 183us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.129021:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782727279.129167:0:8324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8324:1869324912447744:0@lo:502: 00000100:00100000:1.0:1782727279.129234:0:8324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8324:1869324912447872:0@lo:502: 00000100:00100000:1.0:1782727279.129279:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.129306:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912447872 00000100:00100000:1.0:1782727279.129310:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912447872 00000100:00100000:1.0:1782727279.129334:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782727279.129341:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:8324:x1869324912447872:12345-0@lo:502: 00000100:00100000:1.0:1782727279.129407:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:8324:x1869324912447872:12345-0@lo:502: Request processed in 65us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.129414:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782727279.129451:0:8324:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.129462:0:8324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8324:1869324912447872:0@lo:502: 00000040:00080000:1.0:1782727279.129480:0:8324:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782727279.129561:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782727279.129585:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727279.129597:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.129609:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727279.129631:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782727279.129635:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8cef434e9800 from 5 10000000:01000000:1.0:1782727279.129638:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782727279.129670:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.129678:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.129688:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727279.129709:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912448000:0@lo:101: 00000100:00100000:1.0:1782727279.129738:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.129752:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.129763:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912448000 00000100:00100000:1.0:1782727279.129766:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912448000 00000100:00100000:1.0:1782727279.129785:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782727279.129790:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912448000:12345-0@lo:101: 00010000:00010000:1.0:1782727279.129798:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727279.129813:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef82044c00/0x9832bf6cd8a42da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42da1 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.129836:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef82044c00/0x9832bf6cd8a42da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42da1 expref: 17 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.129847:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef82044c00/0x9832bf6cd8a42da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42da1 expref: 17 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.129859:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef82044c00, rc 0) 00000100:00100000:1.0:1782727279.129886:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912448000:12345-0@lo:101: Request processed in 96us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.129892:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782727279.129920:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912448000:0@lo:101: 00010000:00010000:1.0:1782727279.129960:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42da8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.129970:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42da8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727279.130024:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912448128:0@lo:256: 00000100:00100000:1.0:1782727279.130054:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.130067:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.130078:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912448128 00000100:00100000:1.0:1782727279.130082:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912448128 00000100:00100000:1.0:1782727279.130098:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782727279.130104:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912448128:12345-0@lo:256: 20000000:01000000:1.0:1782727279.130118:0:5946:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782727279.130137:0:5946:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782727279.130140:0:5946:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1782727279.130229:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912448128:12345-0@lo:256: Request processed in 125us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.130236:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782727279.130261:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912448128:0@lo:256: 10000000:01000000:1.0:1782727279.130300:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782727279.130305:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42da8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.130312:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef82044400/0x9832bf6cd8a42da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42da8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727279.130320:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1782727279.130322:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1782727279.130324:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782727279.130340:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.130356:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.130364:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727279.130375:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912448256:0@lo:101: 00000100:00100000:1.0:1782727279.130398:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.130410:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.130421:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912448256 00000100:00100000:1.0:1782727279.130425:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912448256 00000100:00100000:1.0:1782727279.130440:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782727279.130446:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912448256:12345-0@lo:101: 00010000:00010000:1.0:1782727279.130453:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727279.130478:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42db6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42daf expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.130493:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42daf expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.130501:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42daf expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.130508:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5800, rc 0) 00000100:00100000:1.0:1782727279.130534:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912448256:12345-0@lo:101: Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.130540:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782727279.130566:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912448256:0@lo:101: 00010000:00010000:1.0:1782727279.130582:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.130590:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727279.130639:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912448384:0@lo:501: 00000100:00100000:1.0:1782727279.130662:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.130675:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.130686:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912448384 00000100:00100000:1.0:1782727279.130689:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912448384 00000100:00100000:1.0:1782727279.130704:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782727279.130709:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912448384:12345-0@lo:501: 00000100:00100000:1.0:1782727279.130822:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912448384:12345-0@lo:501: Request processed in 112us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.130828:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782727279.130852:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912448384:0@lo:501: 00000100:00100000:1.0:1782727279.130879:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912448512:0@lo:503: 00000100:00100000:1.0:1782727279.130954:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.130966:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef703aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.130975:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912448512 00000100:00100000:1.0:1782727279.130978:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912448512 00000100:00100000:1.0:1782727279.130993:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782727279.130997:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912448512:12345-0@lo:503: 00000100:00100000:1.0:1782727279.131067:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912448512:12345-0@lo:503: Request processed in 69us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.131073:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782727279.131113:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912448512:0@lo:503: 00000100:00100000:3.0:1782727279.133670:0:8325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8325:1869324912448640:0@lo:502: 00000100:00100000:3.0:1782727279.133770:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727279.133818:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912448640 00000100:00100000:3.0:1782727279.133826:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912448640 00000100:00100000:3.0:1782727279.133873:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782727279.133882:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+18:8325:x1869324912448640:12345-0@lo:502: 00000100:00100000:3.0:1782727279.134055:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+18:8325:x1869324912448640:12345-0@lo:502: Request processed in 173us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.134064:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782727279.134302:0:8325:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6cbe9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727279.134328:0:8325:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8325:1869324912448640:0@lo:502: 00000020:01000000:3.0:1782727279.134356:0:8325:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782727279.134365:0:8325:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1782727279.134374:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727279.134377:0:8325:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1782727279.134381:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782727279.134386:0:8325:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.123@tcp to nid 0x20000c0a8cc7b (192.168.204.123@tcp) 00000020:01000000:3.0:1782727279.134424:0:8325:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782727279.134428:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727279.134459:0:8325:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cef42b48000) 00000020:00000080:3.0:1782727279.134485:0:8325:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1782727279.134493:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782727279.138821:0:8325:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1782727279.138837:0:8325:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1782727279.138854:0:8325:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9832bf6cd8a42dc4 00010000:00080000:3.0:1782727279.138911:0:8325:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cef77f5a800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:3.0:1782727279.139220:0:8325:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1782727279.139396:0:8325:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1782727279.139414:0:8325:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782727279.140248:0:8325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727279.140447:0:8325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727279.140591:0:8325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1782727279.141496:0:8325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1782727279.143415:0:8326:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782727279.143423:0:8326:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1782727279.157427:0:8325:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782727279.157446:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782727279.157500:0:8325:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1782727279.157528:0:8325:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9832bf6cd8a42dcb 00000100:00080000:3.0:1782727279.157542:0:8325:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782727279.157550:0:8325:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cef77f5a800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1782727279.157598:0:8325:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cef6c9af800 x1869324912448768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782727279.157639:0:8325:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1782727279.157695:0:8325:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727279.157699:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727279.157702:0:8325:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1782727279.157712:0:8325:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727279.157718:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727279.157719:0:8325:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782727279.157722:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782727279.157724:0:8325:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782727279.157759:0:8325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8325:1869324912448896:0@lo:502: 00000100:00100000:3.0:1782727279.157862:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727279.157913:0:8325:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576a300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727279.158382:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3443:1869324912448768:0@lo:8: 00000100:00100000:0.0:1782727279.158443:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727279.158577:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912449024:0@lo:400: 00000100:00100000:0.0:1782727279.158608:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727279.158630:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727279.158644:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912449408:0@lo:400: 00000100:00100000:0.0:1782727279.158671:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727279.158701:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912449152:0@lo:400: 00000100:00100000:0.0:1782727279.158725:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727279.158744:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727279.158749:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912449280:0@lo:400: 00000100:00100000:0.0:1782727279.158773:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727279.158807:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912449024 00000100:00100000:0.0:1782727279.158816:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912449024 00000100:00100000:0.0:1782727279.158857:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912449408 00000100:00100000:0.0:1782727279.158860:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912449408 00000100:00100000:0.0:1782727279.158874:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912449152 00000100:00100000:0.0:1782727279.158876:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912449152 00000100:00100000:0.0:1782727279.158892:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727279.158901:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912449024:12345-0@lo:400: 00000100:00100000:3.0:1782727279.159499:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912448768 00000100:00100000:3.0:1782727279.159504:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912448768 00000100:00100000:3.0:1782727279.159526:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912449280 00000100:00100000:3.0:1782727279.159528:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912449280 00000100:00100000:3.0:1782727279.159547:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727279.159553:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912449280:12345-0@lo:400: 00000100:00100000:3.0:1782727279.159598:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912449280:12345-0@lo:400: Request processed in 45us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.159606:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727279.159798:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912448896 00000100:00100000:2.0:1782727279.159804:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912448896 00000100:00100000:2.0:1782727279.159840:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782727279.159847:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:8325:x1869324912448896:12345-0@lo:502: 00000100:00100000:2.0:1782727279.159998:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:8325:x1869324912448896:12345-0@lo:502: Request processed in 151us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727279.160005:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782727279.160232:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727279.160237:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3443:x1869324912448768:12345-0@lo:8: 00010000:00080000:3.0:1782727279.160265:0:6938:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:3.0:1782727279.160295:0:6938:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9832bf6cd8a42dd2 00002000:00100000:3.0:1782727279.160310:0:6938:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cef77f5d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1782727279.160315:0:6938:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1782727279.160319:0:6938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1782727279.160388:0:6938:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782727279.160647:0:6938:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782727279.160675:0:6938:0:(import.c:65:import_set_state_nolock()) ffff8cef77f5c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782727279.160725:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324912448768:12345-0@lo:8: Request processed in 487us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.160738:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727279.160923:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912449024:12345-0@lo:400: Request processed in 2021us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727279.160948:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727279.160967:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727279.160975:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912449408:12345-0@lo:400: 00000100:00100000:0.0:1782727279.161005:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912449408:12345-0@lo:400: Request processed in 32us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727279.161010:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727279.161019:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727279.161025:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912449152:12345-0@lo:400: 00000100:00100000:0.0:1782727279.161047:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912449152:12345-0@lo:400: Request processed in 22us (2321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727279.161063:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1782727279.161384:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6d9d2d80 x1869324912449280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727279.161401:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912449280:0@lo:400: 00010000:00080000:0.0:1782727279.161412:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6d9d0a80 x1869324912449152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727279.161421:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912449152:0@lo:400: 00010000:00080000:0.0:1782727279.161458:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6c9af800 x1869324912448768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782727289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727279.161467:0:3443:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782727279.161474:0:3443:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782727279.161483:0:3443:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782727279.161490:0:3443:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782727279.161493:0:3443:0:(import.c:65:import_set_state_nolock()) ffff8cef77f5a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782727279.161505:0:3443:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782727279.161509:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3443:1869324912448768:0@lo:8: 00010000:00080000:3.0:1782727279.162275:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6d9d2a00 x1869324912449408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727279.162288:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912449408:0@lo:400: 00010000:00080000:3.0:1782727279.162309:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6d9d0380 x1869324912449024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727279.162318:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912449024:0@lo:400: 00000004:00080000:3.0:1782727279.162345:0:8326:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782727279.162427:0:8326:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 183338498357ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782727279.162434:0:8326:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1782727279.163252:0:8325:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8325:1869324912448896:0@lo:502: 00000020:01000000:3.0:1782727279.163297:0:8325:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727279.163306:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727279.163308:0:8325:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782727279.163314:0:8325:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1782727279.163832:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1782727279.163862:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782727279.163877:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.163889:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727279.163901:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782727279.163904:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cef6cb64d70 from 1 10000000:01000000:1.0:1782727279.163907:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782727279.163978:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.163988:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.163999:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727279.164024:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912449536:0@lo:101: 00000100:00100000:1.0:1782727279.170721:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.170801:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef80271540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727279.171879:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912449536 00000100:00100000:2.0:1782727279.171893:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912449536 00000100:00100000:2.0:1782727279.172457:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782727279.172470:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912449536:12345-0@lo:101: 00010000:00010000:2.0:1782727279.172490:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727279.172510:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41487600/0x9832bf6cd8a42de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42dd9 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727279.172544:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41487600/0x9832bf6cd8a42de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42dd9 expref: 19 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727279.172557:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41487600/0x9832bf6cd8a42de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42dd9 expref: 19 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727279.172568:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41487600, rc 0) 00000100:00100000:2.0:1782727279.172677:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912449536:12345-0@lo:101: Request processed in 209us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727279.172685:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782727279.172792:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912449536:0@lo:101: 00010000:00010000:1.0:1782727279.172814:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.172824:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727279.172916:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912449664:0@lo:501: 00000100:00100000:1.0:1782727279.172983:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727279.197135:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef80271540 going to sleep for 11 seconds 00000100:00100000:0.0:1782727279.201875:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912449664 00000100:00100000:0.0:1782727279.201899:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912449664 00000004:00080000:2.0:1782727279.209856:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1782727279.211024:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912449792:0@lo:13: 00000100:00100000:0.0:1782727279.211126:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782727279.211523:0:8327:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1782727279.211589:0:8327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8327:1869324912449920:0@lo:7: 00000100:00100000:2.0:1782727279.211819:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912449792 00000100:00100000:2.0:1782727279.211829:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912449792 00000100:00100000:2.0:1782727279.211917:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727279.211949:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3445:x1869324912449792:12345-0@lo:13: 00002000:00000024:2.0:1782727279.211988:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1782727279.213669:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727279.213729:0:8327:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576a300 going to sleep for 11 seconds 00000100:00100000:3.0:1782727279.213861:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912449920 00000100:00100000:3.0:1782727279.213872:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912449920 00000100:00100000:3.0:1782727279.213944:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782727279.213954:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8327:x1869324912449920:12345-0@lo:7: 00000100:00100000:2.0:1782727279.214188:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3445:x1869324912449792:12345-0@lo:13: Request processed in 2236us (3035us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727279.214198:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1782727279.214999:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727279.215113:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782727279.215126:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912449664:12345-0@lo:501: 00000100:00100000:1.0:1782727279.215366:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912449664:12345-0@lo:501: Request processed in 244us (42383us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782727279.215389:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782727279.215503:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912449664:0@lo:501: 10000000:01000000:1.0:1782727279.215606:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782727279.215635:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727279.215648:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1782727279.226991:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6c9ac380 x1869324912449792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727279.227026:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912449792:0@lo:13: 00002000:00080000:3.0:1782727279.236955:0:6938:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1782727279.236968:0:6938:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1782727279.237174:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8327:x1869324912449920:12345-0@lo:7: Request processed in 23215us (23504us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.237195:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782727279.243649:0:8327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6c9ac000 x1869324912449920/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782727295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727279.243693:0:8327:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8327:1869324912449920:0@lo:7: 00000004:00080000:0.0:1782727279.243715:0:8327:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1782727279.249686:0:8327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8327:1869324912450048:0@lo:5: 00000100:00100000:3.0:1782727279.249782:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727279.249989:0:8327:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca7d900 going to sleep for 11 seconds 00000100:00100000:1.0:1782727279.259226:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912450048 00000100:00100000:1.0:1782727279.259247:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912450048 00000100:00100000:1.0:1782727279.259350:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727279.259374:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8327:x1869324912450048:12345-0@lo:5: 00002000:00080000:1.0:1782727279.260042:0:6941:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782727279.260049:0:6941:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1782727279.279146:0:8023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1782727279.279170:0:8023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1782727279.279352:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8327:x1869324912450048:12345-0@lo:5: Request processed in 19984us (29563us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782727279.279382:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782727279.280836:0:8327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6c9af100 x1869324912450048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727279.280854:0:8327:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782727279.280863:0:8327:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8327:1869324912450048:0@lo:5: 00000004:00080000:0.0:1782727279.280883:0:8327:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1782727279.280979:0:8327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d9d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8327:1869324912450176:0@lo:700: 00000100:00100000:0.0:1782727279.281050:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727279.281176:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912450176 00000100:00100000:3.0:1782727279.281186:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912450176 00000100:00100000:3.0:1782727279.281255:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727279.281279:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8327:x1869324912450176:12345-0@lo:700: 00000100:00100000:3.0:1782727279.281327:0:6947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6947:1869324912450304:0@lo:700: 00000100:00100000:3.0:1782727279.281360:0:6947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727279.281443:0:6947:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca7d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727279.281462:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912450304 00000100:00100000:3.0:1782727279.281465:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912450304 00000100:00100000:3.0:1782727279.281495:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727279.281501:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6947:x1869324912450304:12345-0@lo:700: 00000100:00100000:0.0:1782727279.281854:0:8327:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef49277900 going to sleep for 11 seconds 40000000:02000000:1.0:1782727279.310725:0:5959:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1782727279.318882:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6947:x1869324912450304:12345-0@lo:700: Request processed in 37371us (37511us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727279.318919:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782727279.319011:0:6947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6c9af100 x1869324912450304/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782727295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727279.319028:0:6947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6947:1869324912450304:0@lo:700: 40000000:02000000:1.0:1782727279.319042:0:6947:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:1.0:1782727279.344379:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727279.348493:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8327:x1869324912450176:12345-0@lo:700: Request processed in 67218us (67432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727279.348511:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782727279.357309:0:8327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6d9d2d80 x1869324912450176/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782727295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727279.357330:0:8327:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d9d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8327:1869324912450176:0@lo:700: 00000004:02000040:0.0:1782727279.375631:0:8327:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1782727279.382711:0:8327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8327:1869324912450432:0@lo:5: 00000100:00100000:2.0:1782727279.382822:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727279.382905:0:8327:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727279.383216:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912450432 00000100:00100000:3.0:1782727279.383226:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912450432 00000100:00100000:3.0:1782727279.383303:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727279.383313:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8327:x1869324912450432:12345-0@lo:5: 00002000:00080000:3.0:1782727279.394507:0:6938:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1782727279.394537:0:6938:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1782727279.397064:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8327:x1869324912450432:12345-0@lo:5: Request processed in 13742us (14232us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782727279.397083:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782727279.397473:0:8327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6fb80 x1869324912450432/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727279.397496:0:8327:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8327:1869324912450432:0@lo:5: 00000004:00080000:3.0:1782727279.397518:0:8327:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:3.0:1782727280.197757:0:8388:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782727280.367538:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782727281.335583:0:8440:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727281.335858:0:8440:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727281.393595:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782727282.113735:0:8023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1782727282.415177:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727283.439185:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727283.697848:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912450560:0@lo:13: 00000100:00100000:2.0:1782727283.697924:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727283.698026:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912450560 00000100:00100000:2.0:1782727283.698033:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912450560 00000100:00100000:2.0:1782727283.698087:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727283.698096:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912450560:12345-0@lo:13: 00002000:00000024:2.0:1782727283.698138:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727283.698183:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912450560:12345-0@lo:13: Request processed in 87us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727283.698190:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1782727283.698211:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727283.702467:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6ea00 x1869324912450560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727283.702492:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912450560:0@lo:13: 00000020:00000004:0.0:1782727283.925252:0:8541:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727283.925436:0:8541:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1782727284.207625:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912451072:0@lo:400: 00000100:00100000:2.0:1782727284.207695:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727284.207762:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782727284.207769:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912450688:0@lo:400: 00000100:00100000:2.0:1782727284.207799:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727284.207822:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912451200:0@lo:400: 00000100:00100000:2.0:1782727284.207844:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727284.207877:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912451072 00000100:00100000:2.0:1782727284.207885:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912451072 00000100:00100000:2.0:1782727284.207962:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727284.207972:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912451072:12345-0@lo:400: 00000100:00100000:2.0:1782727284.208025:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912451072:12345-0@lo:400: Request processed in 54us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727284.208032:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727284.208056:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912450688 00000100:00100000:2.0:1782727284.208060:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912450688 00000100:00100000:2.0:1782727284.208086:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782727284.208092:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3446:x1869324912450688:12345-0@lo:400: 00000100:00100000:2.0:1782727284.208132:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3446:x1869324912450688:12345-0@lo:400: Request processed in 40us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727284.208138:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782727284.208166:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912451200 00000100:00100000:2.0:1782727284.208181:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912451200 00000100:00100000:2.0:1782727284.208217:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782727284.208231:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912451200:12345-0@lo:400: 00000100:00100000:2.0:1782727284.208261:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912451200:12345-0@lo:400: Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727284.208266:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1782727284.208288:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727284.208318:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912450688:0@lo:400: 00010000:00080000:2.0:1782727284.208331:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6d180 x1869324912451200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727284.208342:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912451200:0@lo:400: 00010000:00080000:2.0:1782727284.208353:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6e300 x1869324912451072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727284.208361:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912451072:0@lo:400: 00000100:00100000:1.0:1782727284.208671:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912450816:0@lo:400: 00000100:00100000:1.0:1782727284.208764:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727284.208793:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912451328:0@lo:400: 00000100:00100000:1.0:1782727284.208821:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727284.208839:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727284.208844:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912450944:0@lo:400: 00000100:00100000:1.0:1782727284.208866:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727284.209480:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912451328 00000100:00100000:3.0:1782727284.209486:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912451328 00000100:00100000:3.0:1782727284.209536:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727284.209544:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912451328:12345-0@lo:400: 00000100:00100000:3.0:1782727284.209589:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912451328:12345-0@lo:400: Request processed in 47us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727284.209595:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782727284.209629:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6f480 x1869324912451328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727284.209639:0:3444:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782727284.209649:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912451328:0@lo:400: 00000100:00080000:3.0:1782727284.209664:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727284.209838:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912450816 00000100:00100000:2.0:1782727284.209842:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912450816 00000100:00100000:2.0:1782727284.209877:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912450944 00000100:00100000:2.0:1782727284.209880:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912450944 00000100:00100000:2.0:1782727284.209903:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727284.209910:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912450816:12345-0@lo:400: 00000100:00100000:2.0:1782727284.209976:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912450816:12345-0@lo:400: Request processed in 67us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727284.209983:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727284.209995:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727284.210001:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912450944:12345-0@lo:400: 00000100:00100000:2.0:1782727284.210030:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912450944:12345-0@lo:400: Request processed in 29us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727284.210049:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1782727284.213233:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782727284.213304:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6ce00 x1869324912450944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727284.213322:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912450944:0@lo:400: 00010000:00080000:3.0:1782727284.213337:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6d500 x1869324912450816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727284.213345:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912450816:0@lo:400: 00010000:00010000:0.0:1782727284.471361:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727284.719233:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727284.719257:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912451456:0@lo:13: 00000100:00100000:1.0:1782727284.719327:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727284.719428:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912451456 00000100:00100000:3.0:1782727284.719449:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912451456 00000100:00100000:3.0:1782727284.719528:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727284.719538:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912451456:12345-0@lo:13: 00002000:00000024:3.0:1782727284.719569:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727284.719620:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912451456:12345-0@lo:13: Request processed in 84us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727284.719628:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782727284.719665:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6c9ac380 x1869324912451456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727284.719682:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912451456:0@lo:13: 00000020:00000004:1.0:1782727285.268906:0:8589:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727285.268916:0:8589:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1782727285.488002:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727286.511488:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727287.129748:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727287.129856:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893553024 00000100:00100000:1.0:1782727287.129866:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893553024 00000100:00100000:1.0:1782727287.129916:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:1.0:1782727287.129925:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2335:x1869324893553024:12345-192.168.204.23@tcp:250: 00010000:00080000:1.0:1782727287.130011:0:5947:0:(ldlm_lib.c:1434:target_handle_connect()) MGS: connection from ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2@192.168.204.23@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:1.0:1782727287.130039:0:5947:0:(genops.c:1406:class_connect()) connect: client ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2, cookie 0x9832bf6cd8a42de7 00000100:00080000:1.0:1782727287.130196:0:5947:0:(import.c:65:import_set_state_nolock()) ffff8cef77f2f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727287.130267:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+5:2335:x1869324893553024:12345-192.168.204.23@tcp:250: Request processed in 341us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727287.130275:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:0.0:1782727287.141831:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727287.146820:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893552896 00000100:00100000:2.0:1782727287.146839:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893552896 00000100:00100000:2.0:1782727287.146922:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:2.0:1782727287.146949:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+5:5428:x1869324893552896:12345-192.168.204.23@tcp:101: 00010000:00010000:2.0:1782727287.146968:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727287.146987:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77f20600/0x9832bf6cd8a42dee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a16f expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727287.147018:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77f20600/0x9832bf6cd8a42dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a16f expref: 6 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727287.147030:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77f20600/0x9832bf6cd8a42dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a16f expref: 6 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727287.147039:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f20600, rc 0) 00000100:00100000:2.0:1782727287.147149:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+6:5428:x1869324893552896:12345-192.168.204.23@tcp:101: Request processed in 202us (5328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727287.147158:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:2.0:1782727287.160301:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727287.160393:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893553152 00000100:00100000:3.0:1782727287.160404:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893553152 00000100:00100000:3.0:1782727287.160464:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:3.0:1782727287.160476:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+6:5428:x1869324893553152:12345-192.168.204.23@tcp:501: 00000100:00100000:3.0:1782727287.164842:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+6:5428:x1869324893553152:12345-192.168.204.23@tcp:501: Request processed in 4356us (4541us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782727287.164858:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:0.0:1782727287.170993:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727287.172575:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893553280 00000100:00100000:3.0:1782727287.172593:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893553280 00000100:00100000:3.0:1782727287.172668:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:3.0:1782727287.172679:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+6:5428:x1869324893553280:12345-192.168.204.23@tcp:101: 00010000:00010000:3.0:1782727287.172696:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727287.172713:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42df5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a176 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727287.172741:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a176 expref: 7 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727287.172769:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a176 expref: 7 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727287.172779:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41524800, rc 0) 00000100:00100000:3.0:1782727287.172851:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+7:5428:x1869324893553280:12345-192.168.204.23@tcp:101: Request processed in 174us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727287.172859:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:1.0:1782727287.176166:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727287.176245:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893553408 00000100:00100000:3.0:1782727287.176255:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893553408 00000100:00100000:3.0:1782727287.176317:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:3.0:1782727287.176326:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+7:5428:x1869324893553408:12345-192.168.204.23@tcp:501: 00000100:00100000:3.0:1782727287.176479:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+8:5428:x1869324893553408:12345-192.168.204.23@tcp:501: Request processed in 153us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727287.176487:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:0.0:1782727287.182558:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727287.182674:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893553536 00000100:00100000:2.0:1782727287.182684:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893553536 00000100:00100000:2.0:1782727287.182769:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:2.0:1782727287.182780:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+8:5428:x1869324893553536:12345-192.168.204.23@tcp:503: 00000100:00100000:2.0:1782727287.182947:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+8:5428:x1869324893553536:12345-192.168.204.23@tcp:503: Request processed in 151us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727287.182955:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:0.0:1782727287.185578:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727287.185704:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893553664 00000100:00100000:1.0:1782727287.185712:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893553664 00000100:00100000:1.0:1782727287.185813:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:1.0:1782727287.185824:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+8:5448:x1869324893553664:12345-192.168.204.23@tcp:502: 00000100:00100000:1.0:1782727287.186010:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+8:5448:x1869324893553664:12345-192.168.204.23@tcp:502: Request processed in 187us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727287.186018:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:1.0:1782727287.226183:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727287.226681:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893553792 00000100:00100000:2.0:1782727287.226734:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893553792 00000100:00100000:2.0:1782727287.226791:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:2.0:1782727287.226800:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+8:5448:x1869324893553792:12345-192.168.204.23@tcp:502: 00000100:00100000:2.0:1782727287.227021:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+8:5448:x1869324893553792:12345-192.168.204.23@tcp:502: Request processed in 221us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727287.227029:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:0.0:1782727287.234749:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727287.235265:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893553920 00000100:00100000:1.0:1782727287.235276:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893553920 00000100:00100000:1.0:1782727287.235332:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:1.0:1782727287.235341:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+8:5428:x1869324893553920:12345-192.168.204.23@tcp:101: 00010000:00010000:1.0:1782727287.235359:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727287.235472:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77da4c00/0x9832bf6cd8a42dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a1a0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727287.235499:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77da4c00/0x9832bf6cd8a42dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a0 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727287.235679:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77da4c00/0x9832bf6cd8a42dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a0 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727287.235702:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da4c00, rc 0) 00000100:00100000:1.0:1782727287.235794:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5428:x1869324893553920:12345-192.168.204.23@tcp:101: Request processed in 454us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727287.235802:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:2.0:1782727287.243953:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727287.244030:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893554048 00000100:00100000:1.0:1782727287.244039:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893554048 00000100:00100000:1.0:1782727287.244103:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:1.0:1782727287.244113:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5428:x1869324893554048:12345-192.168.204.23@tcp:256: 20000000:01000000:1.0:1782727287.244139:0:5945:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782727287.244164:0:5945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782727287.244168:0:5945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782727287.244172:0:5945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782727287.244174:0:5945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782727287.251821:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5428:x1869324893554048:12345-192.168.204.23@tcp:256: Request processed in 7698us (7891us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727287.251838:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:3.0:1782727287.256553:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727287.256670:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893554176 00000100:00100000:1.0:1782727287.256693:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893554176 00000100:00100000:1.0:1782727287.256751:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:1.0:1782727287.256762:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5428:x1869324893554176:12345-192.168.204.23@tcp:101: 00010000:00010000:1.0:1782727287.256779:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727287.256795:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77da5e00/0x9832bf6cd8a42e03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a1a7 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727287.256823:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77da5e00/0x9832bf6cd8a42e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a7 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727287.256856:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77da5e00/0x9832bf6cd8a42e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a7 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727287.256866:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5e00, rc 0) 00000100:00100000:1.0:1782727287.256960:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5428:x1869324893554176:12345-192.168.204.23@tcp:101: Request processed in 169us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727287.256968:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:0.0:1782727287.259449:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727287.260201:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893554304 00000100:00100000:1.0:1782727287.260211:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893554304 00000100:00100000:1.0:1782727287.260273:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:1.0:1782727287.260282:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5428:x1869324893554304:12345-192.168.204.23@tcp:501: 00000100:00100000:1.0:1782727287.260653:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5428:x1869324893554304:12345-192.168.204.23@tcp:501: Request processed in 371us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727287.260661:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:2.0:1782727287.264463:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727287.264639:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893554432 00000100:00100000:1.0:1782727287.264650:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893554432 00000100:00100000:1.0:1782727287.264916:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 126 00000100:00100000:1.0:1782727287.264954:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5428:x1869324893554432:12345-192.168.204.23@tcp:503: 00000100:00100000:1.0:1782727287.265153:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5428:x1869324893554432:12345-192.168.204.23@tcp:503: Request processed in 227us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727287.265162:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 126 00000100:00100000:0.0:1782727287.272043:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727287.272158:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893554560 00000100:00100000:3.0:1782727287.272169:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893554560 00000100:00100000:3.0:1782727287.272230:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 127 00000100:00100000:3.0:1782727287.272240:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5453:x1869324893554560:12345-192.168.204.23@tcp:502: 00000100:00100000:3.0:1782727287.272391:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5453:x1869324893554560:12345-192.168.204.23@tcp:502: Request processed in 151us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727287.272400:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 127 00000100:00100000:0.0:1782727287.274146:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727287.274200:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893554688 00000100:00100000:1.0:1782727287.274208:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893554688 00000100:00100000:1.0:1782727287.274297:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:1.0:1782727287.274306:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5453:x1869324893554688:12345-192.168.204.23@tcp:502: 00000100:00100000:1.0:1782727287.274448:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5453:x1869324893554688:12345-192.168.204.23@tcp:502: Request processed in 142us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727287.274455:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:1.0:1782727287.278429:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727287.278902:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893554816 00000100:00100000:2.0:1782727287.278913:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893554816 00000100:00100000:2.0:1782727287.279095:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:2.0:1782727287.279104:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2335:x1869324893554816:12345-192.168.204.23@tcp:38: 00010000:00080000:2.0:1782727287.279146:0:5953:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from 4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1782727287.279194:0:5953:0:(genops.c:1406:class_connect()) connect: client 4c9ff188-fb9c-4b39-a5ed-2408b1373248, cookie 0x9832bf6cd8a42e0a 00000004:00100000:2.0:1782727287.279231:0:5953:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1782727287.279237:0:5953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1782727287.293629:0:5953:0:(import.c:65:import_set_state_nolock()) ffff8cef77dd7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727287.293753:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2335:x1869324893554816:12345-192.168.204.23@tcp:38: Request processed in 14647us (15332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727287.293766:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00010000:00010000:0.0:1782727287.535577:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727288.307195:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727288.307261:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727288.307366:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893554944 00000100:00100000:2.0:1782727288.307378:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893554944 00000100:00100000:2.0:1782727288.307445:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893555072 00000100:00100000:2.0:1782727288.307448:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893555072 00000100:00100000:2.0:1782727288.307466:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:2.0:1782727288.307475:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:0:x1869324893554944:12345-192.168.204.23@tcp:41: 00000004:00000024:2.0:1782727288.307532:0:5954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1782727288.307606:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:0:x1869324893554944:12345-192.168.204.23@tcp:41: Request processed in 132us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727288.307614:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:2.0:1782727288.307629:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1782727288.307635:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:5428:x1869324893555072:12345-192.168.204.23@tcp:41: 00000004:00000024:2.0:1782727288.307646:0:5954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1782727288.307666:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:5428:x1869324893555072:12345-192.168.204.23@tcp:41: Request processed in 31us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727288.307672:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00080000:0.0:1782727288.307974:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727288.317754:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727288.318583:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893555200 00000100:00100000:1.0:1782727288.318594:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893555200 00000100:00100000:1.0:1782727288.318666:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1782727288.318686:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:5428:x1869324893555200:12345-192.168.204.23@tcp:40: 00000100:00100000:1.0:1782727288.318789:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:5428:x1869324893555200:12345-192.168.204.23@tcp:40: Request processed in 114us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727288.318797:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1782727288.325635:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727288.326530:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893555584 00000100:00100000:3.0:1782727288.326542:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893555584 00000100:00100000:3.0:1782727288.326602:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:3.0:1782727288.326613:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:5428:x1869324893555584:12345-192.168.204.23@tcp:33: 00000100:00100000:0.0:1782727288.328296:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727288.328340:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727288.328376:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727288.328407:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893555328 00000100:00100000:0.0:1782727288.328413:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893555328 00000100:00100000:0.0:1782727288.328445:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893555456 00000100:00100000:0.0:1782727288.328448:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893555456 00000100:00100000:0.0:1782727288.328461:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1782727288.328469:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2335:x1869324893555328:12345-192.168.204.23@tcp:8: 00010000:00080000:0.0:1782727288.328497:0:6938:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from 4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1782727288.328531:0:6938:0:(genops.c:1406:class_connect()) connect: client 4c9ff188-fb9c-4b39-a5ed-2408b1373248, cookie 0x9832bf6cd8a42e11 00002000:00100000:0.0:1782727288.328547:0:6938:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c9ff188-fb9c-4b39-a5ed-2408b1373248/ffff8cef7c1ce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782727288.328568:0:6938:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782727288.328765:0:6938:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782727288.328796:0:6938:0:(import.c:65:import_set_state_nolock()) ffff8cef7c1c8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727288.328854:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2335:x1869324893555328:12345-192.168.204.23@tcp:8: Request processed in 384us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727288.328872:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1782727288.328889:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1782727288.328893:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2335:x1869324893555456:12345-192.168.204.23@tcp:8: 00010000:00080000:0.0:1782727288.328907:0:6938:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from 4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1782727288.328924:0:6938:0:(genops.c:1406:class_connect()) connect: client 4c9ff188-fb9c-4b39-a5ed-2408b1373248, cookie 0x9832bf6cd8a42e18 00002000:00100000:0.0:1782727288.328963:0:6938:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c9ff188-fb9c-4b39-a5ed-2408b1373248/ffff8cef7c1c9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782727288.328974:0:6938:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782727288.329097:0:6938:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782727288.329113:0:6938:0:(import.c:65:import_set_state_nolock()) ffff8cef7c1c9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727288.329152:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2335:x1869324893555456:12345-192.168.204.23@tcp:8: Request processed in 256us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727288.329159:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:2.0:1782727288.329495:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893555712 00000100:00100000:2.0:1782727288.329500:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893555712 00000100:00100000:2.0:1782727288.329543:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 129 00000100:00100000:2.0:1782727288.329551:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893555712:12345-192.168.204.23@tcp:400: 00000100:00100000:2.0:1782727288.329590:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893555712:12345-192.168.204.23@tcp:400: Request processed in 40us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727288.329596:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 129 00000004:00080000:3.0:1782727288.364331:0:5955:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 37439us 00000004:00200000:0.0:1782727288.414421:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782727288.414540:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:5428:x1869324893555584:12345-192.168.204.23@tcp:33: Request processed in 87923us (88919us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727288.414554:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00010000:00010000:1.0:1782727288.559217:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727288.615249:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727288.615340:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893555840 00000100:00100000:3.0:1782727288.615350:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893555840 00000100:00100000:3.0:1782727288.615453:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:3.0:1782727288.615464:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:5470:x1869324893555840:12345-192.168.204.23@tcp:101: 00010000:00010000:3.0:1782727288.615483:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727288.615509:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524e00/0x9832bf6cd8a42e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a1d1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727288.615576:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a42e26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727288.615590:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a42e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727288.615604:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a42e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727288.615652:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727288.615656:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727288.615688:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a42e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727288.615715:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524e00/0x9832bf6cd8a42e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1d1 expref: 8 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727288.615736:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a42e26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1d1 expref: 7 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727288.615764:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef700a7700) 00010000:00010000:3.0:1782727288.615767:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727288.615771:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41525e00, rc 0) 00000100:00100000:3.0:1782727288.616257:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:5470:x1869324893555840:12345-192.168.204.23@tcp:101: Request processed in 794us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727288.616265:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1782727288.815283:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912451584:0@lo:13: 00000100:00100000:0.0:1782727288.815360:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727288.815887:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912451584 00000100:00100000:2.0:1782727288.815896:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912451584 00000100:00100000:2.0:1782727288.815989:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727288.816000:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912451584:12345-0@lo:13: 00002000:00000024:2.0:1782727288.816034:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:0.0:1782727288.816165:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727288.816887:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912451584:12345-0@lo:13: Request processed in 885us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727288.816897:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1782727288.818478:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6e300 x1869324912451584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727288.818509:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912451584:0@lo:13: 00000100:00100000:0.0:1782727289.327310:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324912451968:0@lo:400: 00000100:00100000:0.0:1782727289.327411:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727289.327499:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782727289.327507:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912451840:0@lo:400: 00000100:00100000:0.0:1782727289.327541:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727289.327561:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912452352:0@lo:400: 00000100:00100000:0.0:1782727289.327588:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727289.327625:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912451712:0@lo:400: 00000100:00100000:0.0:1782727289.327656:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727289.327691:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3447:1869324912452224:0@lo:400: 00000100:00100000:0.0:1782727289.327713:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727289.327729:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727289.327733:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912452096:0@lo:400: 00000100:00100000:0.0:1782727289.327755:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727289.327785:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912452352 00000100:00100000:0.0:1782727289.327803:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912452352 00000100:00100000:0.0:1782727289.327865:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912452096 00000100:00100000:0.0:1782727289.327868:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912452096 00000100:00100000:0.0:1782727289.327886:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727289.327894:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912452352:12345-0@lo:400: 00000100:00100000:0.0:1782727289.327984:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912452352:12345-0@lo:400: Request processed in 90us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727289.327991:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727289.328019:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727289.328026:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912452096:12345-0@lo:400: 00000100:00100000:0.0:1782727289.328060:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912452096:12345-0@lo:400: Request processed in 34us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727289.328066:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1782727289.328083:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782727289.328110:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6c9aed80 x1869324912452096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727289.328139:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912452096:0@lo:400: 00010000:00080000:0.0:1782727289.328171:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6c9adc00 x1869324912452352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727289.328180:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912452352:0@lo:400: 00000100:00100000:0.0:1782727289.328202:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912451968 00000100:00100000:0.0:1782727289.328205:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912451968 00000100:00100000:0.0:1782727289.328231:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912451840 00000100:00100000:0.0:1782727289.328234:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912451840 00000100:00100000:0.0:1782727289.328244:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912452224 00000100:00100000:0.0:1782727289.328246:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912452224 00000100:00100000:0.0:1782727289.328258:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727289.328264:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324912451968:12345-0@lo:400: 00000100:00100000:0.0:1782727289.328299:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324912451968:12345-0@lo:400: Request processed in 34us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727289.328305:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727289.328316:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727289.328322:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912451840:12345-0@lo:400: 00000100:00100000:0.0:1782727289.328349:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912451840:12345-0@lo:400: Request processed in 27us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727289.328355:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727289.328366:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727289.328372:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1869324912452224:12345-0@lo:400: 00000100:00100000:0.0:1782727289.328399:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1869324912452224:12345-0@lo:400: Request processed in 28us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727289.328406:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1782727289.328426:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727289.328447:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3447:1869324912452224:0@lo:400: 00000100:00100000:0.0:1782727289.328470:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912451840:0@lo:400: 00000100:00100000:0.0:1782727289.328495:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324912451968:0@lo:400: 00000100:00100000:1.0:1782727289.329185:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912451712 00000100:00100000:1.0:1782727289.329191:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912451712 00000100:00100000:1.0:1782727289.329232:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782727289.329239:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912451712:12345-0@lo:400: 00000100:00100000:1.0:1782727289.329290:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912451712:12345-0@lo:400: Request processed in 52us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727289.329296:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782727289.329406:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912451712:0@lo:400: 00010000:00010000:0.0:1782727289.583639:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727289.839265:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727289.839297:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912452480:0@lo:13: 00000100:00100000:2.0:1782727289.839378:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727289.839707:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912452480 00000100:00100000:1.0:1782727289.839717:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912452480 00000100:00100000:1.0:1782727289.839772:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727289.839782:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912452480:12345-0@lo:13: 00002000:00000024:1.0:1782727289.839815:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727289.839916:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912452480:12345-0@lo:13: Request processed in 134us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727289.839963:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1782727289.840110:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6c9afb80 x1869324912452480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727289.840130:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912452480:0@lo:13: 00010000:00010000:0.0:1782727290.610896:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782727290.865992:0:8023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c9ff188-fb9c-4b39-a5ed-2408b1373248 00000100:00100000:2.0:1782727291.235234:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727291.235337:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893555968 00000100:00100000:0.0:1782727291.235347:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893555968 00000100:00100000:0.0:1782727291.235431:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1782727291.235441:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:5522:x1869324893555968:12345-192.168.204.23@tcp:41: 00000004:00000024:0.0:1782727291.235485:0:5953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:0.0:1782727291.235558:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:5522:x1869324893555968:12345-192.168.204.23@tcp:41: Request processed in 118us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727291.235569:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00080000:2.0:1782727291.235637:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727291.242142:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727291.243143:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893556096 00000100:00100000:1.0:1782727291.243157:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893556096 00000100:00100000:1.0:1782727291.243245:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:1.0:1782727291.243255:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:5522:x1869324893556096:12345-192.168.204.23@tcp:13: 00002000:00000024:1.0:1782727291.243288:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:2.0:1782727291.243422:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727291.243458:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:5522:x1869324893556096:12345-192.168.204.23@tcp:13: Request processed in 202us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727291.243465:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:1.0:1782727291.254743:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727291.254851:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893556224 00000100:00100000:3.0:1782727291.254861:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893556224 00000100:00080000:2.0:1782727291.254954:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727291.255004:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:3.0:1782727291.255016:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:5522:x1869324893556224:12345-192.168.204.23@tcp:13: 00002000:00000024:3.0:1782727291.255066:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727291.255138:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:5522:x1869324893556224:12345-192.168.204.23@tcp:13: Request processed in 124us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727291.255146:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00010000:00010000:1.0:1782727291.631280:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727292.658208:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782727292.922095:0:5930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c9ff188-fb9c-4b39-a5ed-2408b1373248 00000100:00100000:0.0:1782727293.401536:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727293.401644:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727293.401690:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727293.401779:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893556608 00000100:00100000:1.0:1782727293.401789:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893556608 00000100:00100000:1.0:1782727293.401860:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:1.0:1782727293.401870:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893556608:12345-192.168.204.23@tcp:400: 00000100:00100000:1.0:1782727293.401984:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893556608:12345-192.168.204.23@tcp:400: Request processed in 114us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727293.401992:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00080000:0.0:1782727293.402218:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727293.402269:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893556480 00000100:00100000:3.0:1782727293.402274:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893556480 00000100:00100000:3.0:1782727293.402326:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:3.0:1782727293.402335:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893556480:12345-192.168.204.23@tcp:400: 00000100:00100000:3.0:1782727293.402389:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893556480:12345-192.168.204.23@tcp:400: Request processed in 56us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727293.402397:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00080000:0.0:1782727293.402535:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727293.402589:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893556352 00000100:00100000:2.0:1782727293.402594:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893556352 00000100:00100000:2.0:1782727293.402668:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 131 00000100:00100000:2.0:1782727293.402677:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893556352:12345-192.168.204.23@tcp:400: 00000100:00100000:2.0:1782727293.402719:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893556352:12345-192.168.204.23@tcp:400: Request processed in 43us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727293.402725:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 131 00000100:00100000:1.0:1782727293.406309:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727293.407625:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893556736 00000100:00100000:2.0:1782727293.407638:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893556736 00000100:00100000:2.0:1782727293.407798:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:2.0:1782727293.407810:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2337:x1869324893556736:12345-192.168.204.23@tcp:400: 00000100:00100000:2.0:1782727293.409393:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2337:x1869324893556736:12345-192.168.204.23@tcp:400: Request processed in 1578us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727293.409406:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00080000:0.0:1782727293.410845:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782727293.679238:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727293.937121:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727293.937145:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912452608:0@lo:13: 00000100:00100000:3.0:1782727293.937216:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727293.937281:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912452608 00000100:00100000:3.0:1782727293.937288:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912452608 00000100:00080000:0.0:1782727293.937318:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727293.937369:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727293.937380:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912452608:12345-0@lo:13: 00002000:00000024:0.0:1782727293.937428:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727293.937483:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912452608:12345-0@lo:13: Request processed in 105us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727293.937490:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1782727293.937843:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6e680 x1869324912452608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727293.938108:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912452608:0@lo:13: 00000001:00100000:1.0:1782727293.945187:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c9ff188-fb9c-4b39-a5ed-2408b1373248 00000100:00100000:3.0:1782727294.447215:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912452736:0@lo:400: 00000100:00100000:3.0:1782727294.447289:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727294.447339:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912453248:0@lo:400: 00000100:00100000:3.0:1782727294.447364:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727294.447633:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727294.447643:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3447:1869324912453120:0@lo:400: 00000100:00100000:3.0:1782727294.447672:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727294.447742:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912452864:0@lo:400: 00000100:00100000:3.0:1782727294.447780:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727294.457899:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324912452992:0@lo:400: 00000100:00100000:3.0:1782727294.458269:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912452736 00000100:00100000:3.0:1782727294.458277:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912452736 00000100:00100000:3.0:1782727294.458335:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782727294.458345:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef46633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912452736:12345-0@lo:400: 00000100:00100000:3.0:1782727294.458418:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef46633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912452736:12345-0@lo:400: Request processed in 75us (11129us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727294.458436:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782727294.458473:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912453248 00000100:00100000:3.0:1782727294.458490:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912453248 00000100:00100000:3.0:1782727294.458534:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727294.458541:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912453248:12345-0@lo:400: 00000100:00100000:3.0:1782727294.458574:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912453248:12345-0@lo:400: Request processed in 35us (11209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727294.458581:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727294.458615:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727294.459218:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912453120 00000100:00100000:1.0:1782727294.459225:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912453120 00000100:00100000:1.0:1782727294.459272:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912452864 00000100:00100000:1.0:1782727294.459276:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912452864 00000100:00100000:1.0:1782727294.459294:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727294.459300:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1869324912453120:12345-0@lo:400: 00000100:00100000:1.0:1782727294.459355:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1869324912453120:12345-0@lo:400: Request processed in 55us (11682us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727294.459362:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727294.459376:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727294.459382:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912452864:12345-0@lo:400: 00000100:00100000:1.0:1782727294.459429:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912452864:12345-0@lo:400: Request processed in 46us (11647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727294.459435:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782727294.474719:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3447:1869324912453120:0@lo:400: 00000100:00100000:3.0:1782727294.474737:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912452736:0@lo:400: 00010000:00080000:3.0:1782727294.475112:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef6c9ac700 x1869324912453248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727294.475125:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912453248:0@lo:400: 00000100:00080000:3.0:1782727294.475156:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727294.475163:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727294.475192:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912452864:0@lo:400: 00000100:00100000:3.0:1782727294.475215:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912452992 00000100:00100000:3.0:1782727294.475221:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912452992 00000100:00100000:3.0:1782727294.475274:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782727294.475284:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324912452992:12345-0@lo:400: 00000100:00100000:3.0:1782727294.475365:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324912452992:12345-0@lo:400: Request processed in 82us (16748us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727294.475372:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1782727294.475465:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727294.475585:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324912452992:0@lo:400: 00000001:02000400:0.0:1782727294.640467:0:8688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1782727294.713217:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727294.961353:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727294.961379:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912453376:0@lo:13: 00000100:00100000:1.0:1782727294.961466:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727294.961721:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912453376 00000100:00100000:3.0:1782727294.961729:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912453376 00000100:00100000:3.0:1782727294.961786:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782727294.961796:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912453376:12345-0@lo:13: 00002000:00000024:3.0:1782727294.961826:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727294.961881:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912453376:12345-0@lo:13: Request processed in 86us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727294.961889:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1782727294.961980:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef70381c00 x1869324912453376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727294.961999:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912453376:0@lo:13: 00010000:00010000:1.0:1782727295.727139:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727296.751660:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727297.779093:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727298.535472:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727298.535506:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727298.535549:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727298.535580:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727298.535611:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893556992 00000100:00100000:0.0:1782727298.535621:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893556992 00000100:00100000:2.0:1782727298.535807:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893556864 00000100:00100000:2.0:1782727298.535823:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893556864 00000100:00100000:2.0:1782727298.535879:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 133 00000100:00100000:2.0:1782727298.535905:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893556864:12345-192.168.204.23@tcp:400: 00000100:00100000:2.0:1782727298.536002:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893556864:12345-192.168.204.23@tcp:400: Request processed in 113us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727298.536010:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 133 00000100:00100000:2.0:1782727298.536161:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893557120 00000100:00100000:2.0:1782727298.536165:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893557120 00000100:00100000:2.0:1782727298.536202:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893557248 00000100:00100000:2.0:1782727298.536205:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893557248 00000100:00100000:2.0:1782727298.536223:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:2.0:1782727298.536229:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2337:x1869324893557120:12345-192.168.204.23@tcp:400: 00000100:00100000:2.0:1782727298.536263:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2337:x1869324893557120:12345-192.168.204.23@tcp:400: Request processed in 34us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727298.536270:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:2.0:1782727298.536282:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1782727298.536288:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2337:x1869324893557248:12345-192.168.204.23@tcp:400: 00000100:00100000:2.0:1782727298.536314:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2337:x1869324893557248:12345-192.168.204.23@tcp:400: Request processed in 27us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727298.536321:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00080000:2.0:1782727298.536336:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727298.536339:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727298.537108:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:0.0:1782727298.537118:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893556992:12345-192.168.204.23@tcp:400: 00000100:00100000:0.0:1782727298.537165:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893556992:12345-192.168.204.23@tcp:400: Request processed in 49us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727298.537171:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00080000:2.0:1782727298.540049:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727298.799333:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727299.055368:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727299.055392:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912453504:0@lo:13: 00000100:00100000:3.0:1782727299.055463:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727299.055530:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912453504 00000100:00100000:3.0:1782727299.055537:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912453504 00000100:00100000:3.0:1782727299.055588:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727299.055598:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912453504:12345-0@lo:13: 00002000:00000024:3.0:1782727299.055629:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727299.055735:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912453504:12345-0@lo:13: Request processed in 138us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727299.055743:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1782727299.055783:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6c700 x1869324912453504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727299.055800:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912453504:0@lo:13: 00000100:00080000:2.0:1782727299.055869:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1782727299.194227:0:8835:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe909a72d0 20000000:00000080:3.0:1782727299.194249:0:8835:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cef77ab0800 uarg=0000000000000000 20000000:01000000:3.0:1782727299.194311:0:8835:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1782727299.194314:0:8835:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1782727299.194321:0:8835:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782727299.194326:0:8835:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782727299.194332:0:8835:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1782727299.194393:0:8835:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782727299.194395:0:8835:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727299.195350:0:8836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1782727299.195640:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1782727299.195749:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1782727299.195767:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1782727299.195777:0:8835:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782727299.195780:0:8835:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727299.196259:0:8837:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1782727299.196423:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1782727299.196445:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1782727299.196460:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1782727299.196469:0:8835:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1782727299.196471:0:8835:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727299.196902:0:8838:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1782727299.197240:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1782727299.197264:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1782727299.197299:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1782727299.197310:0:8835:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782727299.197312:0:8835:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727299.197592:0:8839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1782727299.197804:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1782727299.197839:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1782727299.197856:0:8835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1782727299.197871:0:8835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782727299.197890:0:8835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.197909:0:8835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef82045400/0x9832bf6cd8a42d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d23 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.197917:0:8835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d4d expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.199894:0:8835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d77 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.199900:0:8835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d85 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.199906:0:8835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d93 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.199913:0:8835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42db6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42daf expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.199919:0:8835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41487600/0x9832bf6cd8a42de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42dd9 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.199950:0:8835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef77f20600/0x9832bf6cd8a42dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a16f expref: 9 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.199958:0:8835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a176 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.199966:0:8835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.200016:0:8835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a176 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.200034:0:8835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42df5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a176 expref: 9 pid: 5947 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.200072:0:8835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70383480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912453632:192.168.204.23@tcp:104: 00010000:00010000:3.0:1782727299.200205:0:8835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef77f20600/0x9832bf6cd8a42dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a16f expref: 9 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.200213:0:8835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cef77f20600/0x9832bf6cd8a42dee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a16f expref: 9 pid: 5945 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.200222:0:8835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70383b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912453760:192.168.204.23@tcp:104: 00010000:00010000:3.0:1782727299.200251:0:8835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41487600/0x9832bf6cd8a42de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42dd9 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.200259:0:8835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41487600/0x9832bf6cd8a42de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42dd9 expref: 18 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.200267:0:8835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912453888:0@lo:104: 00000100:00100000:3.0:1782727299.200307:0:8835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727299.200349:0:8835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42daf expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.200357:0:8835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42db6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42daf expref: 18 pid: 5946 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.200365:0:8835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454016:0@lo:104: 00000100:00100000:3.0:1782727299.200389:0:8835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727299.200418:0:8835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42d93 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.200425:0:8835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42d9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d93 expref: 18 pid: 5947 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.200444:0:8835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454144:0@lo:104: 00010000:00010000:3.0:1782727299.200471:0:8835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42d85 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.200480:0:8835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d85 expref: 18 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.200487:0:8835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70380e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454272:0@lo:104: 00010000:00010000:3.0:1782727299.200513:0:8835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42d77 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.200521:0:8835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42d7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d77 expref: 18 pid: 5946 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.200529:0:8835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70382300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454400:0@lo:104: 00010000:00010000:3.0:1782727299.200568:0:8835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42d4d expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.200576:0:8835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42d54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d4d expref: 18 pid: 5947 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.200584:0:8835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454528:0@lo:104: 00010000:00010000:3.0:1782727299.200607:0:8835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef82045400/0x9832bf6cd8a42d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42d23 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.200615:0:8835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef82045400/0x9832bf6cd8a42d2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d23 expref: 18 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.200633:0:8835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70383100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454656:0@lo:104: 00000100:00100000:3.0:1782727299.200652:0:8835:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727299.201236:0:5935:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782727299.201257:0:5935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.201288:0:5935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.201298:0:5935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.201305:0:5935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.201312:0:5935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.201324:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912453888 00000100:00100000:0.0:1782727299.201331:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912453888 00000100:00100000:0.0:1782727299.201369:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912454016 00000100:00100000:0.0:1782727299.201372:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912454016 00000100:00100000:0.0:1782727299.201392:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912454144 00000100:00100000:0.0:1782727299.201394:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912454144 00000100:00100000:0.0:1782727299.201401:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912454272 00000100:00100000:0.0:1782727299.201403:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912454272 00000100:00100000:0.0:1782727299.201409:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912454400 00000100:00100000:0.0:1782727299.201412:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912454400 00000100:00100000:0.0:1782727299.201418:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912454528 00000100:00100000:0.0:1782727299.201420:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912454528 00000100:00100000:0.0:1782727299.201427:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912454656 00000100:00100000:0.0:1782727299.201429:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912454656 00000100:00100000:0.0:1782727299.201441:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727299.201449:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70382a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+9:8835:x1869324912453888:12345-0@lo:104: 00010000:00010000:0.0:1782727299.201462:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.201510:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727299.201516:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70382a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+9:8835:x1869324912453888:12345-0@lo:104: Request processed in 68us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.201522:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727299.201537:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727299.201543:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e2bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+8:8835:x1869324912454016:12345-0@lo:104: 00010000:00010000:0.0:1782727299.201549:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.201574:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782727299.201578:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e2bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+8:8835:x1869324912454016:12345-0@lo:104: Request processed in 37us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.201583:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727299.201615:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727299.201620:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+7:8835:x1869324912454144:12345-0@lo:104: 00010000:00010000:0.0:1782727299.201637:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.201677:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782727299.201682:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+7:8835:x1869324912454144:12345-0@lo:104: Request processed in 62us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.201688:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727299.201700:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727299.201706:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+6:8835:x1869324912454272:12345-0@lo:104: 00010000:00010000:0.0:1782727299.201712:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.201736:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1782727299.201740:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+6:8835:x1869324912454272:12345-0@lo:104: Request processed in 36us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.201746:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727299.201758:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727299.201763:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+5:8835:x1869324912454400:12345-0@lo:104: 00010000:00010000:0.0:1782727299.201771:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.201794:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1782727299.201798:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+5:8835:x1869324912454400:12345-0@lo:104: Request processed in 36us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.201803:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727299.201824:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727299.201830:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:8835:x1869324912454528:12345-0@lo:104: 00010000:00010000:0.0:1782727299.201842:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.201868:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1782727299.201873:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:8835:x1869324912454528:12345-0@lo:104: Request processed in 44us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.201877:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727299.201888:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727299.201893:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:8835:x1869324912454656:12345-0@lo:104: 00010000:00010000:0.0:1782727299.201899:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.201919:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1782727299.201923:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:8835:x1869324912454656:12345-0@lo:104: Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.201953:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1782727299.201969:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1782727299.201975:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.201984:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da4e00 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727299.201988:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.201995:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727299.202002:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727299.202014:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727299.202050:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202056:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727299.202077:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202084:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42de0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202099:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1782727299.202102:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202108:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82044e00 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727299.202110:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202115:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727299.202121:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727299.202126:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727299.202149:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202155:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727299.202166:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202171:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef82044e00/0x9832bf6cd8a42daf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42db6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202180:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782727299.202183:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202189:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82045600 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727299.202191:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202198:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727299.202203:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727299.202207:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727299.202219:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202225:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727299.202239:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202245:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef82045600/0x9832bf6cd8a42d93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d9a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202253:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782727299.202261:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202267:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82044600 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727299.202269:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202276:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727299.202283:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727299.202289:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727299.202315:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202321:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727299.202327:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202335:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef82044600/0x9832bf6cd8a42d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d8c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202344:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782727299.202347:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202353:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41486e00 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727299.202356:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202372:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727299.202377:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727299.202382:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727299.202394:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202399:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727299.202403:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202409:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef41486e00/0x9832bf6cd8a42d77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202418:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782727299.202421:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202426:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82044000 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727299.202429:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202435:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727299.202441:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727299.202452:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727299.202464:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202469:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727299.202473:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202479:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef82044000/0x9832bf6cd8a42d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d54 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202487:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727299.202490:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202496:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273800 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727299.202499:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202504:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727299.202510:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727299.202516:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727299.202524:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202529:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727299.202538:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202545:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef80273800/0x9832bf6cd8a42d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d2a expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.202557:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727299.202559:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727299.202560:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727299.202568:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727299.202574:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727299.202586:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912454784:0@lo:103: 00000100:00100000:0.0:1782727299.202617:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727299.202801:0:8835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912453888:0@lo:104: 00000100:00100000:3.0:1782727299.202811:0:8835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454016:0@lo:104: 00000100:00100000:3.0:1782727299.202830:0:8835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454144:0@lo:104: 00000100:00100000:3.0:1782727299.202837:0:8835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70380e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454272:0@lo:104: 00000100:00100000:3.0:1782727299.202844:0:8835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70382300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454400:0@lo:104: 00000100:00100000:3.0:1782727299.202849:0:8835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454528:0@lo:104: 00000100:00100000:3.0:1782727299.202856:0:8835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70383100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912454656:0@lo:104: 00000100:00100000:0.0:1782727299.203680:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912455296:0@lo:103: 00000100:00100000:0.0:1782727299.203722:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727299.203784:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912454784 00000100:00100000:1.0:1782727299.203791:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912454784 00010000:00010000:1.0:1782727299.203833:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41487600/0x9832bf6cd8a42de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42dd9 expref: 19 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727299.203865:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912455296 00000100:00100000:1.0:1782727299.203868:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912455296 00010000:00010000:1.0:1782727299.203879:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42d7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d77 expref: 20 pid: 5946 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727299.203898:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727299.203913:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+20:3446:x1869324912454784:12345-0@lo:103: 00010000:00010000:1.0:1782727299.203925:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727299.203953:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41487600/0x9832bf6cd8a42de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42dd9 expref: 20 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.203963:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41487600/0x9832bf6cd8a42de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42dd9 expref: 20 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.203979:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41487600/0x9832bf6cd8a42de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42dd9 expref: 20 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.203994:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727299.204025:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+19:3446:x1869324912454784:12345-0@lo:103: Request processed in 112us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727299.204032:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727299.204048:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727299.204054:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+18:3446:x1869324912455296:12345-0@lo:103: 00010000:00010000:1.0:1782727299.204060:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727299.204065:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42d7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d77 expref: 18 pid: 5946 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.204073:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d77 expref: 18 pid: 5946 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.204081:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef82045200/0x9832bf6cd8a42d7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42d77 expref: 18 pid: 5946 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.204089:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727299.204110:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+17:3446:x1869324912455296:12345-0@lo:103: Request processed in 57us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727299.204125:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727299.204627:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912455296:0@lo:103: 00000100:00100000:0.0:1782727299.204654:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912454784:0@lo:103: 00000100:00100000:0.0:1782727299.204677:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782727299.204684:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912454912:0@lo:103: 00000100:00100000:0.0:1782727299.204711:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727299.204765:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912454912 00000100:00100000:1.0:1782727299.204769:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912454912 00010000:00010000:1.0:1782727299.204785:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42db6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42daf expref: 17 pid: 5946 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727299.204811:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727299.204827:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+17:3446:x1869324912454912:12345-0@lo:103: 00010000:00010000:1.0:1782727299.204835:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727299.204839:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42db6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42daf expref: 17 pid: 5946 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.204847:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42daf expref: 17 pid: 5946 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.204857:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42db6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42daf expref: 17 pid: 5946 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.204865:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727299.204888:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+16:3446:x1869324912454912:12345-0@lo:103: Request processed in 62us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727299.204894:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727299.205056:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912455040:0@lo:103: 00000100:00100000:1.0:1782727299.205081:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727299.205205:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912455040 00000100:00100000:2.0:1782727299.205210:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912455040 00010000:00010000:2.0:1782727299.205229:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42d9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d93 expref: 16 pid: 5947 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727299.205299:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782727299.205306:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c805432-a345-4b8b-859c-fa0b2938956c+16:3444:x1869324912455040:12345-0@lo:103: 00010000:00010000:2.0:1782727299.205315:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727299.205318:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42d9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d93 expref: 16 pid: 5947 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727299.205326:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d93 expref: 16 pid: 5947 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727299.205341:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42d93 expref: 16 pid: 5947 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727299.205350:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727299.205375:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c805432-a345-4b8b-859c-fa0b2938956c+15:3444:x1869324912455040:12345-0@lo:103: Request processed in 71us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727299.205381:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727299.205479:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912454912:0@lo:103: 00000100:00100000:0.0:1782727299.205486:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912455424:0@lo:103: 00000100:00100000:0.0:1782727299.205509:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.205554:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912455168:0@lo:103: 00000100:00100000:0.0:1782727299.205576:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.205608:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912455424 00000100:00100000:0.0:1782727299.205617:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912455424 00010000:00010000:0.0:1782727299.205632:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42d54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d4d expref: 15 pid: 5947 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727299.205644:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912455168 00000100:00100000:0.0:1782727299.205647:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912455168 00010000:00010000:0.0:1782727299.205656:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d85 expref: 16 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727299.205681:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727299.205687:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+16:3446:x1869324912455424:12345-0@lo:103: 00010000:00010000:0.0:1782727299.205695:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727299.205699:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42d54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d4d expref: 16 pid: 5947 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.205706:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d4d expref: 16 pid: 5947 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.205716:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41486400/0x9832bf6cd8a42d54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42d4d expref: 16 pid: 5947 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.205726:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727299.205751:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+15:3446:x1869324912455424:12345-0@lo:103: Request processed in 64us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.205757:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727299.205769:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727299.205775:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+14:3445:x1869324912455168:12345-0@lo:103: 00010000:00010000:0.0:1782727299.205783:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727299.205787:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d85 expref: 14 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.205806:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d85 expref: 14 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.205827:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42d85 expref: 14 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.205836:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727299.205863:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+13:3445:x1869324912455168:12345-0@lo:103: Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.205869:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727299.205892:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912455168:0@lo:103: 00000100:00100000:0.0:1782727299.205912:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912455424:0@lo:103: 00000100:00100000:0.0:1782727299.206378:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727299.206408:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727299.206426:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893557504 00000100:00100000:0.0:1782727299.206430:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893557504 00010000:00010000:0.0:1782727299.206448:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef77f20600/0x9832bf6cd8a42dee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a16f expref: 10 pid: 5945 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727299.206467:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893557376 00000100:00100000:0.0:1782727299.206470:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893557376 00010000:00010000:0.0:1782727299.206480:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42df5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a176 expref: 11 pid: 5947 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727299.206495:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:0.0:1782727299.206502:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c967450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+11:2336:x1869324893557504:12345-192.168.204.23@tcp:103: 00010000:00010000:0.0:1782727299.206512:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727299.206525:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef77f20600/0x9832bf6cd8a42dee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a16f expref: 11 pid: 5945 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.206534:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef77f20600/0x9832bf6cd8a42dee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a16f expref: 11 pid: 5945 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.206547:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727299.206582:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c967450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+11:2336:x1869324893557504:12345-192.168.204.23@tcp:103: Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.206589:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:0.0:1782727299.206620:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:0.0:1782727299.206626:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e062300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893557376:12345-192.168.204.23@tcp:103: 00010000:00010000:0.0:1782727299.206633:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727299.206637:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42df5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a176 expref: 10 pid: 5947 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.206648:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42df5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a176 expref: 10 pid: 5947 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.206658:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727299.206688:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e062300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893557376:12345-192.168.204.23@tcp:103: Request processed in 62us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.206696:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00010000:00010000:3.0:1782727299.207061:0:8835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42df5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a176 expref: 9 pid: 5947 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.207074:0:8835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70383480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912453632:192.168.204.23@tcp:104: 00010000:00010000:3.0:1782727299.207084:0:8835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef77f20600/0x9832bf6cd8a42dee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a16f expref: 8 pid: 5945 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727299.207091:0:8835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70383b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8835:1869324912453760:192.168.204.23@tcp:104: 00010000:00010000:3.0:1782727299.207129:0:8835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727299.207904:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912455040:0@lo:103: 00000100:00100000:1.0:1782727299.207916:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912455552:0@lo:103: 00000100:00100000:1.0:1782727299.207984:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.208240:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912455552 00000100:00100000:0.0:1782727299.208247:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912455552 00010000:00010000:0.0:1782727299.208272:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef82045400/0x9832bf6cd8a42d2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d23 expref: 13 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727299.208306:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727299.208322:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+13:3444:x1869324912455552:12345-0@lo:103: 00010000:00010000:0.0:1782727299.208333:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727299.208337:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef82045400/0x9832bf6cd8a42d2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d23 expref: 13 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208346:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef82045400/0x9832bf6cd8a42d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d23 expref: 13 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208360:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef82045400/0x9832bf6cd8a42d2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42d23 expref: 13 pid: 5945 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208374:0:6955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208382:0:6955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208396:0:6955:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208403:0:6955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208408:0:6955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208414:0:6955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208419:0:6955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525600 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:0.0:1782727299.208423:0:6955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208437:0:6955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208460:0:6955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727299.208470:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727299.208509:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+12:3444:x1869324912455552:12345-0@lo:103: Request processed in 188us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.208517:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1782727299.208574:0:8835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.208583:0:8835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.208589:0:8835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41525600/0x9832bf6cd8a42e2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727299.209974:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912455552:0@lo:103: 00000100:00100000:2.0:1782727299.567428:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727299.567542:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727299.567563:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912456064:0@lo:400: 00000100:00100000:0.0:1782727299.567657:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.567728:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3447:1869324912455936:0@lo:400: 00000100:00100000:0.0:1782727299.567755:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.567774:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727299.567780:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912455808:0@lo:400: 00000100:00100000:0.0:1782727299.567802:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.567844:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912456064 00000100:00100000:0.0:1782727299.567851:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912456064 00000100:00100000:0.0:1782727299.567920:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727299.567964:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912456064:12345-0@lo:400: 00000100:00100000:0.0:1782727299.568021:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912456064:12345-0@lo:400: Request processed in 93us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.568029:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727299.568053:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912455936 00000100:00100000:0.0:1782727299.568057:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912455936 00000100:00100000:0.0:1782727299.568096:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912455808 00000100:00100000:0.0:1782727299.568099:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912455808 00000100:00100000:0.0:1782727299.568113:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727299.568118:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1869324912455936:12345-0@lo:400: 00000100:00100000:0.0:1782727299.568157:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1869324912455936:12345-0@lo:400: Request processed in 39us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.568163:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727299.568193:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727299.568200:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912455808:12345-0@lo:400: 00000100:00100000:0.0:1782727299.568227:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912455808:12345-0@lo:400: Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.568232:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1782727299.568251:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782727299.568256:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727299.568326:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912455808:0@lo:400: 00000100:00100000:0.0:1782727299.568336:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3447:1869324912455936:0@lo:400: 00010000:00080000:0.0:1782727299.568363:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef70381180 x1869324912456064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727299.568374:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912456064:0@lo:400: 00000100:00100000:2.0:1782727299.572670:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912455680:0@lo:400: 00000100:00100000:2.0:1782727299.572753:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727299.573672:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912455680 00000100:00100000:0.0:1782727299.573683:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912455680 00000100:00100000:0.0:1782727299.573748:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782727299.573759:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912455680:12345-0@lo:400: 00000100:00100000:0.0:1782727299.573846:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912455680:12345-0@lo:400: Request processed in 89us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727299.573853:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782727299.574075:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912455680:0@lo:400: 00000100:00100000:3.0:1782727299.683023:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727299.683972:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893557632 00000100:00100000:1.0:1782727299.683984:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893557632 00000100:00100000:1.0:1782727299.684043:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 134 00000100:00100000:1.0:1782727299.684054:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+8:5442:x1869324893557632:12345-192.168.204.23@tcp:101: 00010000:00010000:1.0:1782727299.684071:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727299.684090:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42e34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a1d8 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.684119:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1d8 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.684130:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77da5800/0x9832bf6cd8a42e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1d8 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727299.684141:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5800, rc 0) 00000100:00100000:1.0:1782727299.684205:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5442:x1869324893557632:12345-192.168.204.23@tcp:101: Request processed in 152us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727299.684212:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 134 00000100:00100000:0.0:1782727299.691045:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727299.696396:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893557760 00000100:00100000:2.0:1782727299.696412:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893557760 00000100:00100000:2.0:1782727299.696495:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 135 00000100:00100000:2.0:1782727299.696506:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5442:x1869324893557760:12345-192.168.204.23@tcp:501: 00000100:00100000:2.0:1782727299.696761:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5442:x1869324893557760:12345-192.168.204.23@tcp:501: Request processed in 178us (5760us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727299.696786:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 135 00000100:00100000:0.0:1782727299.708017:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727299.708990:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893557888 00000100:00100000:2.0:1782727299.709003:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893557888 00000100:00100000:2.0:1782727299.709126:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 136 00000100:00100000:2.0:1782727299.709137:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5442:x1869324893557888:12345-192.168.204.23@tcp:503: 00000100:00100000:2.0:1782727299.709314:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5442:x1869324893557888:12345-192.168.204.23@tcp:503: Request processed in 179us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727299.709322:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 136 00000100:00100000:3.0:1782727299.718821:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727299.718974:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893558016 00000100:00100000:1.0:1782727299.718985:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893558016 00000100:00100000:1.0:1782727299.719050:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 137 00000100:00100000:1.0:1782727299.719078:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5910:x1869324893558016:12345-192.168.204.23@tcp:502: 00000100:00100000:1.0:1782727299.719310:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5910:x1869324893558016:12345-192.168.204.23@tcp:502: Request processed in 233us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727299.719319:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 137 00000100:00100000:0.0:1782727299.725220:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727299.725495:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893558144 00000100:00100000:2.0:1782727299.725506:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893558144 00000100:00100000:2.0:1782727299.725568:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 138 00000100:00100000:2.0:1782727299.725578:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5910:x1869324893558144:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782727299.725758:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5910:x1869324893558144:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 180us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727299.725766:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 138 00000100:00100000:0.0:1782727299.731727:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727299.732226:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893558272 00000100:00100000:3.0:1782727299.732238:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893558272 00000100:00100000:3.0:1782727299.732324:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 139 00000100:00100000:3.0:1782727299.732337:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5442:x1869324893558272:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727299.732354:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727299.732371:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41524e00/0x9832bf6cd8a42e3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a1df expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.732398:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41524e00/0x9832bf6cd8a42e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1df expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.732408:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41524e00/0x9832bf6cd8a42e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1df expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727299.732417:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41524e00, rc 0) 00000100:00100000:3.0:1782727299.732477:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893558272:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 142us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727299.732483:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 139 00000100:00100000:3.0:1782727299.736764:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727299.737028:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893558400 00000100:00100000:1.0:1782727299.737038:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893558400 00000100:00100000:1.0:1782727299.737098:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 140 00000100:00100000:1.0:1782727299.737109:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893558400:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727299.737374:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893558400:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 266us (619us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782727299.737383:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 140 00010000:00010000:0.0:1782727299.827575:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727300.079436:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727300.079463:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912456192:0@lo:13: 00000100:00100000:2.0:1782727300.079536:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727300.080271:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912456192 00000100:00100000:3.0:1782727300.080281:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912456192 00000100:00100000:3.0:1782727300.080341:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727300.080352:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912456192:12345-0@lo:13: 00002000:00000024:3.0:1782727300.080384:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727300.080450:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912456192:12345-0@lo:13: Request processed in 99us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727300.080457:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1782727300.082055:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef70382300 x1869324912456192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727300.082081:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912456192:0@lo:13: 00010000:00010000:1.0:1782727300.848160:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782727301.039137:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782727301.039146:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cef77814800 from 39 10000000:01000000:1.0:1782727301.039152:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727301.039236:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77da5000/0x9832bf6cd8a42e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727301.039248:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef77da5000/0x9832bf6cd8a42e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727301.039262:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef77da5000/0x9832bf6cd8a42e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727301.039289:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912456320:0@lo:101: 00000100:00100000:1.0:1782727301.039400:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727301.039569:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4807f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727301.047821:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912456320 00000100:00100000:2.0:1782727301.047849:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912456320 00000100:00100000:3.0:1782727301.051644:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782727301.051663:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+12:5949:x1869324912456320:12345-0@lo:101: 00010000:00010000:3.0:1782727301.051707:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727301.051734:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42e49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42e42 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.051775:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e42 expref: 13 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.051802:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41524800/0x9832bf6cd8a42e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e42 expref: 13 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.051811:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41524800, rc 0) 00000100:00100000:3.0:1782727301.051906:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+13:5949:x1869324912456320:12345-0@lo:101: Request processed in 249us (12506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727301.051914:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782727301.052071:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912456320:0@lo:101: 00010000:00010000:0.0:1782727301.052091:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef77da5000/0x9832bf6cd8a42e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e49 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.052100:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef77da5000/0x9832bf6cd8a42e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42e49 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.052201:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912456448:0@lo:501: 00000100:00100000:0.0:1782727301.052240:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.052273:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6da90000 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.052290:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912456448 00000100:00100000:0.0:1782727301.052296:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912456448 00000100:00100000:0.0:1782727301.052322:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782727301.052329:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912456448:12345-0@lo:501: 00000100:00100000:0.0:1782727301.052459:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912456448:12345-0@lo:501: Request processed in 131us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.052467:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782727301.052500:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912456448:0@lo:501: 00000100:00100000:0.0:1782727301.052525:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912456576:0@lo:503: 00000100:00100000:0.0:1782727301.052563:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.052577:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6da90000 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.052588:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912456576 00000100:00100000:0.0:1782727301.052598:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912456576 00000100:00100000:0.0:1782727301.052616:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782727301.052622:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912456576:12345-0@lo:503: 00000100:00100000:0.0:1782727301.052697:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912456576:12345-0@lo:503: Request processed in 74us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.052704:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782727301.052741:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912456576:0@lo:503: 00000100:00100000:0.0:1782727301.053037:0:8858:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8858:1869324912456704:0@lo:502: 00000100:00100000:0.0:1782727301.053071:0:8858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.053089:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912456704 00000100:00100000:0.0:1782727301.053093:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912456704 00000100:00100000:0.0:1782727301.053110:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782727301.053116:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:8858:x1869324912456704:12345-0@lo:502: 00000100:00100000:0.0:1782727301.053188:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:8858:x1869324912456704:12345-0@lo:502: Request processed in 71us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.053194:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782727301.053221:0:8858:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6da90480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.053234:0:8858:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8858:1869324912456704:0@lo:502: 00000100:00100000:0.0:1782727301.053275:0:8858:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8858:1869324912456832:0@lo:502: 00000100:00100000:0.0:1782727301.053308:0:8858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.053326:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912456832 00000100:00100000:0.0:1782727301.053329:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912456832 00000100:00100000:0.0:1782727301.053345:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782727301.053351:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:8858:x1869324912456832:12345-0@lo:502: 00000100:00100000:0.0:1782727301.053406:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:8858:x1869324912456832:12345-0@lo:502: Request processed in 54us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.053421:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782727301.053447:0:8858:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.053458:0:8858:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8858:1869324912456832:0@lo:502: 00000040:00080000:0.0:1782727301.053478:0:8858:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782727301.053537:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782727301.053558:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727301.053566:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77da5000/0x9832bf6cd8a42e42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e49 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.053576:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef77da5000/0x9832bf6cd8a42e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e49 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727301.053585:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1782727301.053587:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1782727301.053590:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782727301.053610:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80273c00/0x9832bf6cd8a42e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.053617:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef80273c00/0x9832bf6cd8a42e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.053625:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef80273c00/0x9832bf6cd8a42e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.053636:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912456960:0@lo:101: 00000100:00100000:0.0:1782727301.053662:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.053674:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.053685:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912456960 00000100:00100000:0.0:1782727301.053688:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912456960 00000100:00100000:0.0:1782727301.053712:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782727301.053717:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+14:5949:x1869324912456960:12345-0@lo:101: 00010000:00010000:0.0:1782727301.053724:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727301.053734:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef80272200/0x9832bf6cd8a42e57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42e50 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.053751:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef80272200/0x9832bf6cd8a42e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e50 expref: 15 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.053759:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef80272200/0x9832bf6cd8a42e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e50 expref: 15 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.053767:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80272200, rc 0) 00000100:00100000:0.0:1782727301.053810:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912456960:12345-0@lo:101: Request processed in 92us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.053815:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782727301.053845:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912456960:0@lo:101: 00010000:00010000:0.0:1782727301.053855:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef80273c00/0x9832bf6cd8a42e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e57 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.053864:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef80273c00/0x9832bf6cd8a42e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42e57 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.053898:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912457088:0@lo:501: 00000100:00100000:0.0:1782727301.053920:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.053953:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.053965:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912457088 00000100:00100000:0.0:1782727301.053967:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912457088 00000100:00100000:0.0:1782727301.053983:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782727301.053995:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912457088:12345-0@lo:501: 00000100:00100000:0.0:1782727301.054081:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912457088:12345-0@lo:501: Request processed in 86us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.054087:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782727301.054115:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912457088:0@lo:501: 00000100:00100000:0.0:1782727301.054138:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912457216:0@lo:503: 00000100:00100000:0.0:1782727301.054169:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.054181:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.054191:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912457216 00000100:00100000:0.0:1782727301.054194:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912457216 00000100:00100000:0.0:1782727301.054210:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782727301.054216:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912457216:12345-0@lo:503: 00000100:00100000:0.0:1782727301.054283:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912457216:12345-0@lo:503: Request processed in 66us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.054288:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782727301.054321:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912457216:0@lo:503: 00000100:00100000:0.0:1782727301.054539:0:8859:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8859:1869324912457344:0@lo:502: 00000100:00100000:0.0:1782727301.054572:0:8859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.054588:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912457344 00000100:00100000:0.0:1782727301.054592:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912457344 00000100:00100000:0.0:1782727301.054609:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782727301.054614:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:8859:x1869324912457344:12345-0@lo:502: 00000100:00100000:0.0:1782727301.054676:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:8859:x1869324912457344:12345-0@lo:502: Request processed in 61us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.054682:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782727301.054712:0:8859:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f600 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.054723:0:8859:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8859:1869324912457344:0@lo:502: 00000020:01000000:0.0:1782727301.054746:0:8859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727301.054754:0:8859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727301.054757:0:8859:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782727301.054762:0:8859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782727301.054797:0:8859:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8859:1869324912457472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727301.054830:0:8859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.054847:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912457472 00000100:00100000:0.0:1782727301.054851:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912457472 00000100:00100000:0.0:1782727301.054867:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782727301.054872:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:8859:x1869324912457472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727301.054968:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:8859:x1869324912457472:12345-0@lo:502:llog_process_th.0 Request processed in 95us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.054975:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782727301.055001:0:8859:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6ca0f600 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.055012:0:8859:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8859:1869324912457472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727301.055031:0:8859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727301.055035:0:8859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727301.055037:0:8859:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782727301.055041:0:8859:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1782727301.055079:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1782727301.055092:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782727301.055100:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80273c00/0x9832bf6cd8a42e50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e57 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.055109:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef80273c00/0x9832bf6cd8a42e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e57 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727301.055128:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782727301.055130:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cef46963800 from 39 10000000:01000000:0.0:1782727301.055132:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727301.055152:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80272e00/0x9832bf6cd8a42e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.055161:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef80272e00/0x9832bf6cd8a42e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.055170:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef80272e00/0x9832bf6cd8a42e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.055183:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912457600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.055208:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.055220:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef474f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.055232:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912457600 00000100:00100000:0.0:1782727301.055234:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912457600 00000100:00100000:0.0:1782727301.055250:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782727301.055256:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+15:5949:x1869324912457600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727301.055264:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727301.055274:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef80272400/0x9832bf6cd8a42e65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42e5e expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.055292:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef80272400/0x9832bf6cd8a42e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e5e expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.055302:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef80272400/0x9832bf6cd8a42e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e5e expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.055322:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80272400, rc 0) 00000100:00100000:0.0:1782727301.055350:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912457600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.055356:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782727301.055383:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912457600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727301.055394:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef80272e00/0x9832bf6cd8a42e5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e65 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.055402:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef80272e00/0x9832bf6cd8a42e5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42e65 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.055437:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912457728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.055461:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.055472:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef474f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.055482:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912457728 00000100:00100000:0.0:1782727301.055485:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912457728 00000100:00100000:0.0:1782727301.055500:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782727301.055505:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912457728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.055586:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912457728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.055592:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782727301.055615:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912457728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.055636:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912457856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.055667:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.055685:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef474f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.055695:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912457856 00000100:00100000:0.0:1782727301.055698:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912457856 00000100:00100000:0.0:1782727301.055714:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782727301.055719:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912457856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.055776:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912457856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727301.056419:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912457856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.061089:0:8860:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8860:1869324912457984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727301.061181:0:8860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727301.061223:0:8860:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db746c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727301.061806:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912457984 00000100:00100000:3.0:1782727301.061816:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912457984 00000100:00100000:3.0:1782727301.061903:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782727301.061915:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:8860:x1869324912457984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727301.062332:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:8860:x1869324912457984:12345-0@lo:502:llog_process_th.0 Request processed in 417us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727301.062341:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782727301.062511:0:8860:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8860:1869324912457984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727301.062591:0:8860:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8860:1869324912458112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727301.062631:0:8860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727301.062662:0:8860:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db746c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727301.062756:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912458112 00000100:00100000:3.0:1782727301.062761:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912458112 00000100:00100000:3.0:1782727301.062806:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782727301.062814:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:8860:x1869324912458112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727301.062904:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:8860:x1869324912458112:12345-0@lo:502:llog_process_th.0 Request processed in 91us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727301.062922:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782727301.067151:0:8860:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8860:1869324912458112:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782727301.067234:0:8860:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782727301.067510:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782727301.067537:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727301.067551:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80272e00/0x9832bf6cd8a42e5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e65 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.067562:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef80272e00/0x9832bf6cd8a42e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e65 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727301.067573:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782727301.067576:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1782727301.067579:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727301.067616:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41524000/0x9832bf6cd8a42e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.067624:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef41524000/0x9832bf6cd8a42e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.067633:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef41524000/0x9832bf6cd8a42e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727301.067654:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70380e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912458240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727301.067717:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727301.067762:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798300 going to sleep for 11 seconds 00000100:00100000:2.0:1782727301.068309:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912458240 00000100:00100000:2.0:1782727301.068317:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912458240 00000100:00100000:2.0:1782727301.068368:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782727301.068379:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912458240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727301.068396:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727301.068413:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77f20400/0x9832bf6cd8a42e73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42e6c expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.068453:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77f20400/0x9832bf6cd8a42e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e6c expref: 17 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.068465:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77f20400/0x9832bf6cd8a42e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e6c expref: 17 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.068477:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f20400, rc 0) 00000100:00100000:2.0:1782727301.068528:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912458240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727301.068552:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782727301.068663:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70380e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912458240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727301.068677:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef41524000/0x9832bf6cd8a42e6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e73 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.068696:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef41524000/0x9832bf6cd8a42e6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42e73 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727301.068764:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70380e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912458368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727301.068808:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727301.068837:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798300 going to sleep for 11 seconds 00000100:00100000:2.0:1782727301.069030:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912458368 00000100:00100000:2.0:1782727301.069036:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912458368 00000100:00100000:2.0:1782727301.069061:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782727301.069287:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912458368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.069530:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912458368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727301.069537:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782727301.069578:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782727301.071642:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70380e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912458368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727301.071707:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70380e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912458496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727301.071795:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727301.071897:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798300 going to sleep for 11 seconds 00000100:00100000:1.0:1782727301.073030:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912458496 00000100:00100000:1.0:1782727301.073047:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912458496 00000100:00100000:2.0:1782727301.079751:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782727301.079787:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912458496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.079990:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912458496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (8196us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727301.079999:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782727301.080097:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70380e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912458496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.080326:0:8861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8861:1869324912458624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727301.080372:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727301.080391:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912458624 00000100:00100000:1.0:1782727301.080397:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912458624 00000100:00100000:0.0:1782727301.080400:0:8861:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef474f86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.080509:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782727301.080517:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:8861:x1869324912458624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727301.080609:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:8861:x1869324912458624:12345-0@lo:502:llog_process_th.0 Request processed in 93us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.080616:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782727301.083164:0:8861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8861:1869324912458624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727301.083209:0:8861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727301.083221:0:8861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727301.083224:0:8861:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782727301.083229:0:8861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782727301.083266:0:8861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8861:1869324912458752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727301.083343:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727301.083384:0:8861:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4807f000 going to sleep for 11 seconds 00000100:00100000:2.0:1782727301.085262:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912458752 00000100:00100000:2.0:1782727301.085281:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912458752 00000100:00100000:2.0:1782727301.085353:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782727301.085363:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:8861:x1869324912458752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727301.085550:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+16:8861:x1869324912458752:12345-0@lo:502:llog_process_th.0 Request processed in 187us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727301.085559:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782727301.087075:0:8861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8861:1869324912458752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727301.087120:0:8861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727301.087127:0:8861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727301.087129:0:8861:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782727301.087134:0:8861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1782727301.090847:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1782727301.090889:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782727301.090904:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41524000/0x9832bf6cd8a42e6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e73 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.090917:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef41524000/0x9832bf6cd8a42e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e73 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727301.090954:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782727301.090965:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cef434e9800 from 39 10000000:01000000:0.0:1782727301.090969:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727301.091009:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80272800/0x9832bf6cd8a42e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.091019:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef80272800/0x9832bf6cd8a42e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.091030:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef80272800/0x9832bf6cd8a42e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.091059:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e061500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912458880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.091134:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.091182:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef474f8780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727301.091191:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912458880 00000100:00100000:2.0:1782727301.091199:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912458880 00000100:00100000:2.0:1782727301.091253:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782727301.091262:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912458880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727301.091276:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727301.091295:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77f21800/0x9832bf6cd8a42e81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42e7a expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.091320:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77f21800/0x9832bf6cd8a42e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e7a expref: 17 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.091330:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77f21800/0x9832bf6cd8a42e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e7a expref: 17 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.091338:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f21800, rc 0) 00000100:00100000:2.0:1782727301.091394:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912458880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727301.091401:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782727301.091581:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e061500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912458880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727301.091597:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef80272800/0x9832bf6cd8a42e7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e81 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727301.091605:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef80272800/0x9832bf6cd8a42e7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42e81 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727301.091667:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912459008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727301.091707:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727301.091731:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7532b900 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.092139:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912459008 00000100:00100000:0.0:1782727301.092145:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912459008 00000100:00100000:0.0:1782727301.092182:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782727301.092190:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912459008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.092327:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912459008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.092335:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782727301.092720:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912459008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727301.092759:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912459136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727301.092817:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727301.092905:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7532b900 going to sleep for 11 seconds 00000100:00100000:3.0:1782727301.093774:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912459136 00000100:00100000:3.0:1782727301.093791:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912459136 00000100:00100000:3.0:1782727301.093851:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782727301.093869:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912459136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727301.094309:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912459136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 440us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727301.094317:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782727301.097113:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912459136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.097760:0:8862:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8862:1869324912459264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727301.097863:0:8862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727301.097904:0:8862:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db749c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.097964:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912459264 00000100:00100000:0.0:1782727301.097972:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912459264 00000100:00100000:0.0:1782727301.098022:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782727301.098033:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+17:8862:x1869324912459264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727301.098173:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+17:8862:x1869324912459264:12345-0@lo:502:llog_process_th.0 Request processed in 141us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.098189:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1782727301.098302:0:8862:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8862:1869324912459264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727301.098346:0:8862:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8862:1869324912459392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727301.098379:0:8862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727301.098410:0:8862:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727301.098527:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912459392 00000100:00100000:2.0:1782727301.098532:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912459392 00000100:00100000:2.0:1782727301.098557:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782727301.098564:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:8862:x1869324912459392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727301.098630:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:8862:x1869324912459392:12345-0@lo:502:llog_process_th.0 Request processed in 66us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727301.098637:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1782727301.098746:0:8862:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8862:1869324912459392:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782727301.098765:0:8862:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782727301.099300:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782727301.099323:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782727301.099333:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80272800/0x9832bf6cd8a42e7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e81 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.099345:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef80272800/0x9832bf6cd8a42e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e81 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727301.099364:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782727301.099366:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1782727301.099369:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782727301.099394:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77f20e00/0x9832bf6cd8a42e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.099403:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef77f20e00/0x9832bf6cd8a42e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.099411:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef77f20e00/0x9832bf6cd8a42e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727301.099427:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912459520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.099460:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.099741:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912459520 00000100:00100000:0.0:1782727301.099747:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912459520 00000100:00100000:0.0:1782727301.099793:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1782727301.099801:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912459520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727301.099812:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727301.099824:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef80272000/0x9832bf6cd8a42e8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42e88 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.099867:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef80272000/0x9832bf6cd8a42e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e88 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.099879:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef80272000/0x9832bf6cd8a42e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e88 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.099889:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80272000, rc 0) 00000100:00100000:0.0:1782727301.099919:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912459520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.099946:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782727301.100182:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727301.100201:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912459520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727301.100213:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef77f20e00/0x9832bf6cd8a42e88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e8f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.100222:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef77f20e00/0x9832bf6cd8a42e88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42e8f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727301.100273:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912459648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.100300:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727301.100325:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.100803:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912459648 00000100:00100000:0.0:1782727301.100809:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912459648 00000100:00100000:0.0:1782727301.101067:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1782727301.101076:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912459648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.101216:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912459648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727301.102047:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912459648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.102162:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912459776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.102216:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727301.102245:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727301.102298:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912459776 00000100:00100000:1.0:1782727301.102303:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912459776 00000100:00100000:1.0:1782727301.102341:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782727301.102348:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912459776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727301.102449:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912459776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727301.102456:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1782727301.103078:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912459776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.103612:0:8863:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8863:1869324912459904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727301.103658:0:8863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.103737:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1782727301.103790:0:8863:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db749c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.103858:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912459904 00000100:00100000:0.0:1782727301.103869:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912459904 00000100:00100000:0.0:1782727301.103906:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1782727301.103912:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+18:8863:x1869324912459904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727301.104048:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+18:8863:x1869324912459904:12345-0@lo:502:llog_process_th.0 Request processed in 135us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.104055:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1782727301.104122:0:8863:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8863:1869324912459904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727301.104145:0:8863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727301.104155:0:8863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727301.104157:0:8863:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782727301.104164:0:8863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782727301.104187:0:8863:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8863:1869324912460032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727301.104221:0:8863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727301.104252:0:8863:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727301.104303:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912460032 00000100:00100000:2.0:1782727301.104308:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912460032 00000100:00100000:2.0:1782727301.104329:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1782727301.104335:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:8863:x1869324912460032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727301.104418:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:8863:x1869324912460032:12345-0@lo:502:llog_process_th.0 Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727301.104426:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1782727301.104495:0:8863:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8863:1869324912460032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727301.104526:0:8863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727301.104531:0:8863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727301.104532:0:8863:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782727301.104536:0:8863:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1782727301.104707:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1782727301.104730:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782727301.104740:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77f20e00/0x9832bf6cd8a42e88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e8f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.104751:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef77f20e00/0x9832bf6cd8a42e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e8f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727301.104763:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782727301.104765:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cef6cb64d70 from 1 10000000:01000000:2.0:1782727301.104768:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782727301.104802:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77f20200/0x9832bf6cd8a42e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.104810:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef77f20200/0x9832bf6cd8a42e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.104827:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef77f20200/0x9832bf6cd8a42e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727301.104841:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912460160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.104879:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727301.104901:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74540 going to sleep for 11 seconds 00000100:00100000:1.0:1782727301.104917:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912460160 00000100:00100000:1.0:1782727301.104922:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912460160 00000100:00100000:1.0:1782727301.105031:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782727301.105038:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912460160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727301.105046:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727301.105058:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77da4200/0x9832bf6cd8a42e9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42e96 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727301.105078:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77da4200/0x9832bf6cd8a42e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e96 expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727301.105164:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77da4200/0x9832bf6cd8a42e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42e96 expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727301.105173:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da4200, rc 0) 00000100:00100000:1.0:1782727301.105214:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912460160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727301.105220:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782727301.105596:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912460160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727301.105613:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef77f20200/0x9832bf6cd8a42e96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e9d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.105623:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef77f20200/0x9832bf6cd8a42e96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42e9d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727301.105678:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912460288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727301.105705:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727301.105730:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74540 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.106675:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912460288 00000100:00100000:0.0:1782727301.106685:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912460288 00000100:00100000:0.0:1782727301.106734:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1782727301.106743:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912460288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727301.107571:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912460288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 826us (1861us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727301.107581:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1782727301.107682:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912460288:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1782727301.107732:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782727301.107744:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77f20200/0x9832bf6cd8a42e96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e9d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727301.107754:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef77f20200/0x9832bf6cd8a42e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42e9d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782727301.546334:0:8894:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff45618d0 20000000:00000080:1.0:1782727301.546359:0:8894:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cef77f9e000 uarg=0000000000000000 20000000:01000000:1.0:1782727301.546399:0:8894:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782727301.546405:0:8894:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782727301.546410:0:8894:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782727301.546800:0:8895:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1782727301.547095:0:8894:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1782727301.550761:0:8894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1782727301.550809:0:8894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1782727301.550827:0:8894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1782727301.550853:0:8894:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782727301.550874:0:8894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.550894:0:8894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef40030400/0x9832bf6cd8a42c19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c12 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.550904:0:8894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42c7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42c74 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.550911:0:8894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42d46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42d3f expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.551491:0:8894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef77da5e00/0x9832bf6cd8a42e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a7 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.551501:0:8894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.551656:0:8894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef77da5e00/0x9832bf6cd8a42e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a7 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.551672:0:8894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cef77da5e00/0x9832bf6cd8a42e03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a7 expref: 9 pid: 5947 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.551689:0:8894:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8894:1869324912460416:192.168.204.23@tcp:104: 00010000:00010000:0.0:1782727301.551816:0:8894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42d3f expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.551825:0:8894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42d46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d3f expref: 18 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.551834:0:8894:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e063800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8894:1869324912460544:0@lo:104: 00000100:00100000:0.0:1782727301.551873:0:8894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.551910:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912460544 00000100:00100000:0.0:1782727301.551918:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912460544 00000100:00100000:0.0:1782727301.551984:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727301.551993:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:8894:x1869324912460544:12345-0@lo:104: 00010000:00010000:0.0:1782727301.552006:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.552060:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727301.552067:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+3:8894:x1869324912460544:12345-0@lo:104: Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.552074:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1782727301.552095:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727301.552101:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.552108:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41486c00 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:0.0:1782727301.552112:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.552120:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727301.552128:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727301.552134:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782727301.552159:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.552165:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727301.552185:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.552191:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef41486c00/0x9832bf6cd8a42d3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42d46 expref: -99 pid: 8022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.552213:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727301.552215:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727301.552216:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727301.552223:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727301.552236:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912460672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782727301.552261:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727301.552287:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912460672 00000100:00100000:0.0:1782727301.552291:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912460672 00010000:00010000:0.0:1782727301.552307:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42d46 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d3f expref: 19 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.552329:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782727301.552336:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912460672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782727301.552347:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727301.552351:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42d46 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d3f expref: 19 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.552360:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42d46 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42d3f expref: 19 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.552377:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727301.552403:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912460672:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727301.552410:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782727301.552439:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912460672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782727301.552469:0:8894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42c7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42c74 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.552487:0:8894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42c7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c74 expref: 18 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.552496:0:8894:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e061c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8894:1869324912460800:0@lo:104: 00000100:00100000:0.0:1782727301.552523:0:8894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727301.552545:0:8894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef40030400/0x9832bf6cd8a42c19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42c12 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.552554:0:8894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef40030400/0x9832bf6cd8a42c19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c12 expref: 18 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.552562:0:8894:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e063480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8894:1869324912460928:0@lo:104: 00000100:00100000:0.0:1782727301.552578:0:8894:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef4576a240 going to sleep for 11 seconds 00010000:00010000:0.0:1782727301.552589:0:8894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42d46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42d3f expref: 18 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.552600:0:8894:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e063800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8894:1869324912460544:0@lo:104: 00000100:00100000:3.0:1782727301.552812:0:8032:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782727301.552830:0:8032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727301.552848:0:8032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912460800 00000100:00100000:3.0:1782727301.552852:0:8032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912460800 00000100:00100000:3.0:1782727301.552874:0:8032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912460928 00000100:00100000:3.0:1782727301.552876:0:8032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912460928 00000100:00100000:3.0:1782727301.552886:0:8032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727301.552892:0:8032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e139c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2c805432-a345-4b8b-859c-fa0b2938956c+4:8894:x1869324912460800:12345-0@lo:104: 00010000:00010000:3.0:1782727301.552900:0:8032:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553036:0:8032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727301.553042:0:8032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e139c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2c805432-a345-4b8b-859c-fa0b2938956c+4:8894:x1869324912460800:12345-0@lo:104: Request processed in 151us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727301.553048:0:8032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727301.553079:0:8032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727301.553092:0:8032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2c805432-a345-4b8b-859c-fa0b2938956c+3:8894:x1869324912460928:12345-0@lo:104: 00010000:00010000:3.0:1782727301.553099:0:8032:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef82045e00/0x9832bf6cd8a42c12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553133:0:8032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782727301.553137:0:8032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2c805432-a345-4b8b-859c-fa0b2938956c+3:8894:x1869324912460928:12345-0@lo:104: Request processed in 47us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727301.553142:0:8032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1782727301.553169:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727301.553174:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553181:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef40030e00 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:3.0:1782727301.553184:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553191:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727301.553197:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727301.553202:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782727301.553219:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553225:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727301.553238:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553253:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef40030e00/0x9832bf6cd8a42c74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c7b expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553265:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727301.553268:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef82045e00/0x9832bf6cd8a42c12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553273:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82045e00 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:3.0:1782727301.553276:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef82045e00/0x9832bf6cd8a42c12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553283:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef82045e00/0x9832bf6cd8a42c12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727301.553289:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef82045e00/0x9832bf6cd8a42c12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727301.553294:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782727301.553307:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef82045e00/0x9832bf6cd8a42c12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553313:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727301.553331:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef82045e00/0x9832bf6cd8a42c12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553337:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef82045e00/0x9832bf6cd8a42c12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42c19 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553350:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727301.553357:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727301.553359:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727301.553366:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727301.553375:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912461056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727301.553403:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727301.553440:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912461184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727301.553463:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727301.553493:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912461056 00000100:00100000:3.0:1782727301.553498:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912461056 00010000:00010000:3.0:1782727301.553515:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42c7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c74 expref: 18 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727301.553536:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912461184 00000100:00100000:3.0:1782727301.553539:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912461184 00010000:00010000:3.0:1782727301.553549:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef40030400/0x9832bf6cd8a42c19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c12 expref: 19 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727301.553560:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727301.553565:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70382680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912461056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727301.553574:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727301.553578:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42c7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c74 expref: 19 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553587:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42c7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c74 expref: 19 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553599:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727301.553625:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70382680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912461056:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727301.553631:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727301.553652:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727301.553658:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70380700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+18:3444:x1869324912461184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727301.553665:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727301.553669:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef40030400/0x9832bf6cd8a42c19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c12 expref: 18 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553677:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef40030400/0x9832bf6cd8a42c19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42c12 expref: 18 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.553686:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727301.553709:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70380700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c805432-a345-4b8b-859c-fa0b2938956c+18:3444:x1869324912461184:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727301.553714:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727301.553744:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912461184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727301.553764:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912461056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782727301.554350:0:8894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42c7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42c74 expref: 17 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.554362:0:8894:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e061c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8894:1869324912460800:0@lo:104: 00010000:00010000:0.0:1782727301.554374:0:8894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef40030400/0x9832bf6cd8a42c19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42c12 expref: 16 pid: 5946 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.554381:0:8894:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e063480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8894:1869324912460928:0@lo:104: 00000100:00100000:0.0:1782727301.555961:0:8894:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8894:1869324912460416:192.168.204.23@tcp:104: 00010000:00010000:0.0:1782727301.555995:0:8894:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727301.557020:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727301.557183:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893558528 00000100:00100000:3.0:1782727301.557191:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893558528 00010000:00010000:3.0:1782727301.557224:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef77da5e00/0x9832bf6cd8a42e03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a7 expref: 10 pid: 5947 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727301.557263:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:3.0:1782727301.557271:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893558528:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782727301.557285:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727301.557290:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef77da5e00/0x9832bf6cd8a42e03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a7 expref: 10 pid: 5947 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557301:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef77da5e00/0x9832bf6cd8a42e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a7 expref: 10 pid: 5947 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557327:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef77da5e00/0x9832bf6cd8a42e03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1a7 expref: 10 pid: 5947 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557342:0:6955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557350:0:6955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557363:0:6955:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557370:0:6955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557377:0:6955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557384:0:6955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557390:0:6955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273200 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:3.0:1782727301.557394:0:6955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557402:0:6955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557425:0:6955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727301.557443:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727301.557522:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:2336:x1869324893558528:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 251us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727301.557530:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00010000:00010000:1.0:1782727301.557586:0:8894:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727301.557595:0:8894:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727301.557602:0:8894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef80273200/0x9832bf6cd8a42ea4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727301.873436:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727302.897672:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782727302.959012:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782727302.959043:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8cef77814800 from 4 10000000:01000000:2.0:1782727302.959050:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727302.959125:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727302.959140:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727302.959153:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727302.959186:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912461312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727302.959314:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727302.959390:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef77f37000 going to sleep for 11 seconds 00000100:00100000:1.0:1782727302.959566:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912461312 00000100:00100000:1.0:1782727302.959577:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912461312 00000100:00100000:1.0:1782727302.959646:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782727302.959657:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912461312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727302.959674:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727302.959689:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77da5400/0x9832bf6cd8a42eb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42eab expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727302.959717:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77da5400/0x9832bf6cd8a42eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42eab expref: 17 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727302.959728:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77da5400/0x9832bf6cd8a42eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42eab expref: 17 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727302.959738:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5400, rc 0) 00000100:00100000:1.0:1782727302.959801:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912461312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727302.959818:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782727302.959873:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912461312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727302.959890:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727302.959899:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727302.960010:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912461440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727302.960042:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727302.960056:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7532b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727302.962235:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912461440 00000100:00100000:3.0:1782727302.962254:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912461440 00000100:00100000:3.0:1782727302.962324:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782727302.962334:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912461440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.962573:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912461440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727302.962581:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782727302.962647:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912461440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.962710:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912461568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.962774:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.962805:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef517989c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727302.962819:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912461568 00000100:00100000:3.0:1782727302.962822:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912461568 00000100:00100000:3.0:1782727302.962840:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782727302.962845:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912461568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.962925:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912461568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727302.962953:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782727302.962988:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912461568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.963196:0:8934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8934:1869324912461696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727302.963230:0:8934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.963262:0:8934:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798000 going to sleep for 11 seconds 00000100:00100000:1.0:1782727302.963481:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912461696 00000100:00100000:1.0:1782727302.963487:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912461696 00000100:00100000:1.0:1782727302.963521:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782727302.963529:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:8934:x1869324912461696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727302.963612:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:8934:x1869324912461696:12345-0@lo:502:llog_process_th.0 Request processed in 84us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727302.963619:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782727302.963980:0:8934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8934:1869324912461696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727302.964009:0:8934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727302.964023:0:8934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727302.964026:0:8934:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782727302.964032:0:8934:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cef77814800 00000020:00000080:3.0:1782727302.964035:0:8934:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727302.964120:0:8934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8934:1869324912461824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727302.964915:0:8934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.964991:0:8934:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798000 going to sleep for 11 seconds 00000100:00100000:2.0:1782727302.965277:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912461824 00000100:00100000:2.0:1782727302.965286:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912461824 00000100:00100000:2.0:1782727302.965336:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782727302.965345:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:8934:x1869324912461824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727302.965486:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:8934:x1869324912461824:12345-0@lo:502:llog_process_th.0 Request processed in 141us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727302.965494:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782727302.967373:0:8934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8934:1869324912461824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727302.967426:0:8934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727302.967436:0:8934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727302.967438:0:8934:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782727302.967443:0:8934:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1782727302.967636:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1782727302.967666:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727302.967681:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727302.967694:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727302.967706:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727302.967716:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8cef46963800 from 4 10000000:01000000:1.0:1782727302.967719:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727302.967772:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727302.967781:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727302.967789:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727302.967815:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912461952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727302.967892:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727302.967963:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef474f8600 going to sleep for 11 seconds 00000100:00100000:3.0:1782727302.968094:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912461952 00000100:00100000:3.0:1782727302.968101:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912461952 00000100:00100000:3.0:1782727302.968166:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782727302.968175:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912461952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727302.968190:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727302.968205:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42ec0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42eb9 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.968247:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42eb9 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.968272:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42eb9 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.968282:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41525400, rc 0) 00000100:00100000:3.0:1782727302.968328:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912461952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727302.968336:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782727302.968378:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912461952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727302.968393:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.968403:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727302.968461:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912462080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.968488:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.968507:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798300 going to sleep for 11 seconds 00000100:00100000:3.0:1782727302.968517:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912462080 00000100:00100000:3.0:1782727302.968521:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912462080 00000100:00100000:3.0:1782727302.968543:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782727302.968549:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912462080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.968669:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912462080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727302.968675:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782727302.968702:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912462080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.968735:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912462208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.968783:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.968795:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798300 going to sleep for 11 seconds 00000100:00100000:3.0:1782727302.968805:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912462208 00000100:00100000:3.0:1782727302.968808:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912462208 00000100:00100000:3.0:1782727302.968823:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782727302.968829:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912462208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.968907:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912462208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727302.968914:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782727302.968979:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912462208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.969159:0:8936:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8936:1869324912462336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727302.969193:0:8936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.969211:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912462336 00000100:00100000:3.0:1782727302.969215:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912462336 00000100:00100000:3.0:1782727302.969238:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782727302.969244:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:8936:x1869324912462336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727302.969319:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:8936:x1869324912462336:12345-0@lo:502:llog_process_th.0 Request processed in 74us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727302.969325:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782727302.969358:0:8936:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727302.969370:0:8936:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8936:1869324912462336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727302.969390:0:8936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727302.969399:0:8936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727302.969405:0:8936:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782727302.969412:0:8936:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cef46963800 00000020:00000080:3.0:1782727302.969414:0:8936:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727302.969491:0:8936:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8936:1869324912462464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727302.969524:0:8936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.969541:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912462464 00000100:00100000:3.0:1782727302.969546:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912462464 00000100:00100000:3.0:1782727302.969566:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782727302.969573:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:8936:x1869324912462464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727302.969630:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:8936:x1869324912462464:12345-0@lo:502:llog_process_th.0 Request processed in 58us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727302.969637:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782727302.969664:0:8936:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727302.969675:0:8936:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8936:1869324912462464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727302.969693:0:8936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727302.969697:0:8936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727302.969699:0:8936:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782727302.969703:0:8936:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782727302.969769:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782727302.969788:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782727302.969796:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.969806:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727302.969816:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782727302.969818:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8cef434e9800 from 4 10000000:01000000:3.0:1782727302.969821:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727302.969850:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.969858:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.969867:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727302.969880:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912462592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.969908:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.969921:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef700b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727302.969949:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912462592 00000100:00100000:3.0:1782727302.969953:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912462592 00000100:00100000:3.0:1782727302.969974:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782727302.969979:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912462592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727302.969988:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727302.970000:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42ece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42ec7 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.970018:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42ec7 expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.970027:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42ec7 expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.970035:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41524400, rc 0) 00000100:00100000:3.0:1782727302.970060:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912462592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727302.970065:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782727302.970100:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912462592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727302.970112:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727302.970120:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727302.970165:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912462720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.970189:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.970205:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef700b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727302.970216:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912462720 00000100:00100000:3.0:1782727302.970219:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912462720 00000100:00100000:3.0:1782727302.970238:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782727302.970244:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912462720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.970322:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912462720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727302.970329:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782727302.970356:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912462720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.970381:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912462848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.974133:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.974504:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727302.977582:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912462848 00000100:00100000:1.0:1782727302.977603:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912462848 00000100:00100000:1.0:1782727302.977682:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782727302.977695:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912462848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727302.978505:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912462848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 808us (4377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727302.978516:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782727302.978768:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912462848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727302.982488:0:8938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8938:1869324912462976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727302.982613:0:8938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.982736:0:8938:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798300 going to sleep for 11 seconds 00000100:00100000:1.0:1782727302.982808:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912462976 00000100:00100000:1.0:1782727302.982818:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912462976 00000100:00100000:1.0:1782727302.983002:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782727302.983014:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:8938:x1869324912462976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727302.983255:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:8938:x1869324912462976:12345-0@lo:502:llog_process_th.0 Request processed in 242us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727302.983265:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782727302.983356:0:8938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8938:1869324912462976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727302.983394:0:8938:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727302.983407:0:8938:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727302.983538:0:8938:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782727302.983550:0:8938:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cef434e9800 00000020:00000080:3.0:1782727302.983553:0:8938:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727302.983706:0:8938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8938:1869324912463104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727302.983760:0:8938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727302.983789:0:8938:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef51798300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727302.984357:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912463104 00000100:00100000:0.0:1782727302.984365:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912463104 00000100:00100000:0.0:1782727302.984405:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782727302.984413:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:8938:x1869324912463104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727302.988921:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:8938:x1869324912463104:12345-0@lo:502:llog_process_th.0 Request processed in 4493us (5146us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727302.988953:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782727302.988980:0:8938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c805432-a345-4b8b-859c-fa0b2938956c:8938:1869324912463104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727302.989037:0:8938:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727302.989047:0:8938:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727302.989050:0:8938:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782727302.989056:0:8938:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1782727302.997786:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1782727302.997856:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782727302.997873:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727302.997891:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727303.322039:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727303.322208:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893558656 00000100:00100000:1.0:1782727303.322220:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893558656 00000100:00100000:1.0:1782727303.322291:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 188 00000100:00100000:1.0:1782727303.322302:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5442:x1869324893558656:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727303.322323:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727303.322346:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77da4800/0x9832bf6cd8a42ed5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a1e6 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727303.322380:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77da4800/0x9832bf6cd8a42ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1e6 expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727303.322394:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77da4800/0x9832bf6cd8a42ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1e6 expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727303.322405:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da4800, rc 0) 00000100:00100000:1.0:1782727303.322490:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893558656:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 189us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727303.322497:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 188 00000100:00100000:3.0:1782727303.330601:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727303.330755:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893558784 00000100:00100000:0.0:1782727303.330771:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893558784 00000100:00100000:0.0:1782727303.330985:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 189 00000100:00100000:0.0:1782727303.330999:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893558784:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727303.332409:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893558784:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 1401us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727303.332424:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 189 00000100:00100000:0.0:1782727303.335567:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727303.336155:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893558912 00000100:00100000:3.0:1782727303.336169:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893558912 00000100:00100000:3.0:1782727303.336235:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 190 00000100:00100000:3.0:1782727303.336248:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893558912:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727303.336419:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893558912:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 174us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727303.338153:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 190 00000100:00100000:0.0:1782727303.357142:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727303.357192:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893559040 00000100:00100000:0.0:1782727303.357204:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893559040 00000100:00100000:0.0:1782727303.357271:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 191 00000100:00100000:0.0:1782727303.357295:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5974:x1869324893559040:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782727303.357505:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5974:x1869324893559040:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 212us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727303.357513:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 191 00000100:00100000:0.0:1782727303.364795:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727303.364839:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893559168 00000100:00100000:0.0:1782727303.364852:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893559168 00000100:00100000:0.0:1782727303.364920:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 192 00000100:00100000:0.0:1782727303.364965:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5974:x1869324893559168:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782727303.365138:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5974:x1869324893559168:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 207us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727303.365144:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 192 00000100:00100000:0.0:1782727303.646126:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727303.646179:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727303.646210:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727303.646241:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893559296 00000100:00100000:0.0:1782727303.646254:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893559296 00000100:00100000:0.0:1782727303.646334:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:0.0:1782727303.646346:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893559296:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727303.646444:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893559296:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 101us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727303.646453:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:0.0:1782727303.646482:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893559424 00000100:00100000:0.0:1782727303.646496:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893559424 00000100:00100000:0.0:1782727303.646528:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893559552 00000100:00100000:0.0:1782727303.646531:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893559552 00000100:00100000:0.0:1782727303.646549:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:0.0:1782727303.646556:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2338:x1869324893559424:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727303.646584:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2338:x1869324893559424:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727303.646590:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:0.0:1782727303.646603:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:0.0:1782727303.646608:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2338:x1869324893559552:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727303.646630:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2338:x1869324893559552:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 22us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727303.646635:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00080000:0.0:1782727303.646652:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727303.646656:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727303.646659:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727303.921626:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727304.176959:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727304.176991:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912463232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727304.177088:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727304.177289:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912463232 00000100:00100000:3.0:1782727304.177300:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912463232 00000100:00100000:3.0:1782727304.177379:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727304.177389:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912463232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727304.177433:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727304.177867:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912463232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 477us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727304.177877:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1782727304.177906:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727304.178032:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef70381f80 x1869324912463232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727304.178056:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912463232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727304.689474:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727304.695300:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912463488:0@lo:400:kworker.0 00000100:00100000:0.0:1782727304.695412:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727304.695496:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912463360:0@lo:400:kworker.0 00000100:00100000:0.0:1782727304.695539:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727304.695782:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912463360 00000100:00100000:1.0:1782727304.695797:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912463360 00000100:00100000:3.0:1782727304.695806:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912463488 00000100:00100000:3.0:1782727304.695816:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912463488 00000100:00100000:1.0:1782727304.695867:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782727304.695878:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782727304.695882:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912463360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727304.695893:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912463488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727304.698863:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912463616:0@lo:400:kworker.0 00000100:00100000:0.0:1782727304.698954:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912463744:0@lo:400:kworker.0 00000100:00100000:1.0:1782727304.703688:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912463872:0@lo:400:kworker.0 00000100:00100000:3.0:1782727304.704925:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912463488:12345-0@lo:400:kworker.0 Request processed in 9025us (9505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727304.704987:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782727304.709566:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727304.709736:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912463488:0@lo:400:kworker.0 00000100:00100000:0.0:1782727304.709850:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912463360:12345-0@lo:400:kworker.0 Request processed in 13973us (14308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727304.709878:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782727304.709960:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912463360:0@lo:400:kworker.0 00000100:00100000:3.0:1782727304.710372:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912463744 00000100:00100000:3.0:1782727304.710381:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912463744 00000100:00100000:3.0:1782727304.710441:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1782727304.710624:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727304.711795:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912463744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727304.711945:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912463744:12345-0@lo:400:kworker.0 Request processed in 1478us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727304.711966:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782727304.712983:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727304.713172:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912463744:0@lo:400:kworker.0 00000100:00100000:3.0:1782727304.713475:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912463616 00000100:00100000:3.0:1782727304.713484:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912463616 00000100:00100000:3.0:1782727304.713567:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727304.713577:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912463616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727304.713645:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912463616:12345-0@lo:400:kworker.0 Request processed in 70us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727304.713674:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782727304.713777:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912463616:0@lo:400:kworker.0 00000100:00080000:0.0:1782727304.713845:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727304.715033:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727304.717008:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912463872 00000100:00100000:0.0:1782727304.717029:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912463872 00000100:00100000:0.0:1782727304.717150:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727304.717164:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912463872:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782727304.717617:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727304.717688:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912463872:12345-0@lo:400:kworker.0 Request processed in 523us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727304.717697:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1782727304.721097:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6e300 x1869324912463872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727304.721122:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912463872:0@lo:400:kworker.0 00010000:00010000:0.0:1782727304.943876:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727305.199849:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912464000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727305.199987:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727305.200144:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912464000 00000100:00100000:1.0:1782727305.200155:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912464000 00000100:00100000:1.0:1782727305.200234:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782727305.200254:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912464000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727305.200308:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727305.213540:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912464000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13281us (13538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727305.213560:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1782727305.219874:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef70381f80 x1869324912464000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727305.219913:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912464000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782727305.967231:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727306.992071:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727308.015191:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727308.764690:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727308.764740:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727308.764775:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727308.764806:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727308.764838:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893559808 00000100:00100000:0.0:1782727308.764850:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893559808 00000100:00100000:0.0:1782727308.764976:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:0.0:1782727308.764987:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2339:x1869324893559808:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727308.765085:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2339:x1869324893559808:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 99us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727308.765093:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:0.0:1782727308.765123:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893560064 00000100:00100000:0.0:1782727308.765127:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893560064 00000100:00100000:0.0:1782727308.765154:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893559936 00000100:00100000:0.0:1782727308.765157:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893559936 00000100:00100000:0.0:1782727308.765173:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:0.0:1782727308.765178:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2339:x1869324893560064:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727308.765207:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2339:x1869324893560064:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727308.765213:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:0.0:1782727308.765224:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:0.0:1782727308.765230:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2339:x1869324893559936:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727308.765252:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2339:x1869324893559936:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 22us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727308.765259:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00080000:0.0:1782727308.765280:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727308.765285:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727308.765287:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727308.765564:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893559680 00000100:00100000:3.0:1782727308.765570:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893559680 00000100:00100000:3.0:1782727308.765616:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 194 00000100:00100000:3.0:1782727308.765623:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2339:x1869324893559680:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727308.765670:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2339:x1869324893559680:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 47us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727308.765676:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 194 00010000:00010000:3.0:1782727309.039080:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727309.295883:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727309.295904:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912464128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727309.295996:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727309.296059:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912464128 00000100:00100000:2.0:1782727309.296065:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912464128 00000100:00100000:2.0:1782727309.296125:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727309.296136:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912464128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727309.296165:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727309.296211:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912464128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727309.296219:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1782727309.296238:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727309.296267:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6e300 x1869324912464128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727309.296285:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912464128:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1782727309.567880:0:9192:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1782727309.807958:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912464512:0@lo:400:kworker.0 00000100:00100000:1.0:1782727309.808036:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727309.808105:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727309.808113:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912464384:0@lo:400:kworker.0 00000100:00100000:1.0:1782727309.808227:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727309.808250:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912464256:0@lo:400:kworker.0 00000100:00100000:3.0:1782727309.808314:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912464640:0@lo:400:kworker.0 00000100:00100000:1.0:1782727309.808508:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912464512 00000100:00100000:2.0:1782727309.808519:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727309.808547:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912464768:0@lo:400:kworker.0 00000100:00100000:2.0:1782727309.808576:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727309.808627:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912464384 00000100:00100000:2.0:1782727309.808634:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912464384 00000100:00100000:2.0:1782727309.808683:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782727309.808692:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912464384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727309.808759:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912464384:12345-0@lo:400:kworker.0 Request processed in 68us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727309.808775:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782727309.808801:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912464256 00000100:00100000:2.0:1782727309.808805:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912464256 00000100:00100000:2.0:1782727309.808840:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1782727309.808848:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef434fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912464256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727309.808876:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912464512 00000100:00100000:3.0:1782727309.809233:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727309.809426:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912464640 00000100:00100000:1.0:1782727309.809432:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912464640 00000100:00100000:1.0:1782727309.809460:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727309.809467:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912464512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727309.809617:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef434fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912464256:12345-0@lo:400:kworker.0 Request processed in 761us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727309.809626:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1782727309.809662:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912464768 00000100:00100000:2.0:1782727309.809666:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912464768 00000100:00100000:2.0:1782727309.809696:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727309.809703:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912464768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727309.809738:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912464768:12345-0@lo:400:kworker.0 Request processed in 34us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727309.809744:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727309.809761:0:5951:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727309.809769:0:5951:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1782727309.809789:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727309.809794:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727309.809801:0:5954:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727309.809809:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782727309.809816:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912464640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727309.809852:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912464640:12345-0@lo:400:kworker.0 Request processed in 36us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727309.809858:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782727309.809991:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912464640:0@lo:400:kworker.0 00000100:00100000:2.0:1782727309.810027:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912464384:0@lo:400:kworker.0 00000100:00100000:2.0:1782727309.810054:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912464512:0@lo:400:kworker.0 00000100:00100000:3.0:1782727309.810489:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912464256:0@lo:400:kworker.0 00010000:00080000:3.0:1782727309.810506:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e1db100 x1869324912464768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727309.810517:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912464768:0@lo:400:kworker.0 00000100:00100000:1.0:1782727309.810620:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912464512:12345-0@lo:400:kworker.0 Request processed in 44us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727309.810628:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1782727310.063695:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727310.321024:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912464896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727310.321135:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727310.321869:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912464896 00000100:00100000:3.0:1782727310.321883:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912464896 00000100:00100000:3.0:1782727310.322004:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727310.322017:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912464896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727310.322060:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727310.322136:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912464896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727310.322144:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1782727310.322523:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef70383800 x1869324912464896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727310.322548:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912464896:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727311.088146:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727312.129973:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727313.135486:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727313.895767:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727313.895801:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727313.895825:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727313.895859:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727313.895888:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893560192 00000100:00100000:3.0:1782727313.895898:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893560192 00000100:00100000:3.0:1782727313.895969:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 196 00000100:00100000:3.0:1782727313.895979:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef46633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893560192:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727313.896051:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef46633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893560192:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 73us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727313.896058:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 196 00000100:00100000:3.0:1782727313.896091:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893560320 00000100:00100000:3.0:1782727313.896095:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893560320 00000100:00100000:3.0:1782727313.896134:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:3.0:1782727313.896141:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893560320:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727313.896190:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893560320:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 49us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727313.896197:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:3.0:1782727313.896217:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893560448 00000100:00100000:3.0:1782727313.896220:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893560448 00000100:00100000:3.0:1782727313.896244:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893560576 00000100:00100000:3.0:1782727313.896247:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893560576 00000100:00100000:3.0:1782727313.896265:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:3.0:1782727313.896272:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2335:x1869324893560448:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:3.0:1782727313.896299:0:6941:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9832bf6cd8a42e11 00000100:00080000:3.0:1782727313.896308:0:6941:0:(import.c:65:import_set_state_nolock()) ffff8cef7c1c8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782727313.896359:0:6941:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782727313.896502:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+2:2335:x1869324893560448:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 230us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727313.896510:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:3.0:1782727313.896523:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:3.0:1782727313.896543:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2335:x1869324893560576:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:3.0:1782727313.896557:0:6941:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9832bf6cd8a42e18 00000100:00080000:3.0:1782727313.896563:0:6941:0:(import.c:65:import_set_state_nolock()) ffff8cef7c1c9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782727313.896586:0:6941:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782727313.896657:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+2:2335:x1869324893560576:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 127us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727313.896663:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00080000:3.0:1782727313.896685:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727313.896689:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727313.896691:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727313.896752:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727313.896758:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727314.159123:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727314.274265:0:9436:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing yml_node 00000100:00100000:0.0:1782727314.422978:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912465024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727314.423062:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727314.423141:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912465024 00000100:00100000:0.0:1782727314.423148:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912465024 00000100:00100000:0.0:1782727314.423218:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727314.423228:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912465024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727314.423259:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727314.423304:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912465024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727314.423312:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1782727314.423335:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782727314.423367:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e060000 x1869324912465024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727314.423384:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912465024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727314.930779:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912465280:0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.930840:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727314.930882:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912465792:0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.930902:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727314.930946:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782727314.930951:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912465152:0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.930979:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727314.930998:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912465664:0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.931032:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727314.931061:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912465408:0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.931083:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727314.931100:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727314.931104:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef469ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912465536:0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.931125:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727314.931153:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912465280 00000100:00100000:2.0:1782727314.931160:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912465280 00000100:00100000:2.0:1782727314.931204:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912465664 00000100:00100000:2.0:1782727314.931208:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912465664 00000100:00100000:2.0:1782727314.931228:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912465408 00000100:00100000:2.0:1782727314.931231:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912465408 00000100:00100000:2.0:1782727314.931247:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782727314.931254:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912465280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.931303:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912465280:12345-0@lo:400:kworker.0 Request processed in 48us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727314.931310:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782727314.931325:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782727314.931331:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912465664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.931355:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912465664:12345-0@lo:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727314.931361:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782727314.931371:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727314.931376:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912465408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.931403:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912465408:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727314.931408:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727314.931424:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912465792 00000100:00100000:2.0:1782727314.931427:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912465792 00000100:00100000:2.0:1782727314.931449:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912465536 00000100:00100000:2.0:1782727314.931452:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912465536 00000100:00100000:2.0:1782727314.931871:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727314.931882:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912465792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.931918:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912465792:12345-0@lo:400:kworker.0 Request processed in 38us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727314.932037:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727314.932051:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782727314.932057:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912465536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.932088:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912465536:12345-0@lo:400:kworker.0 Request processed in 31us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727314.932093:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782727314.932110:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912465152 00000100:00100000:2.0:1782727314.932113:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912465152 00000100:00100000:2.0:1782727314.932140:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1782727314.932146:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912465152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.932170:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912465152:12345-0@lo:400:kworker.0 Request processed in 25us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727314.932176:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1782727314.932209:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727314.932213:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727314.932236:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912465152:0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.932248:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912465664:0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.932257:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912465280:0@lo:400:kworker.0 00010000:00080000:2.0:1782727314.932268:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef469ac000 x1869324912465792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727314.932278:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912465792:0@lo:400:kworker.0 00010000:00080000:2.0:1782727314.932310:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef469ace00 x1869324912465536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727314.932319:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912465536:0@lo:400:kworker.0 00000100:00100000:2.0:1782727314.932336:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef469af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912465408:0@lo:400:kworker.0 00010000:00010000:1.0:1782727315.183132:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727315.441727:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef70380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912465920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727315.441846:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727315.443485:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912465920 00000100:00100000:2.0:1782727315.443508:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912465920 00000100:00100000:2.0:1782727315.448520:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727315.448552:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912465920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727315.448606:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727315.448731:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912465920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (6885us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727315.448740:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1782727315.449042:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef70380e00 x1869324912465920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727315.449074:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef70380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912465920:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782727316.207113:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727317.233897:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727318.255161:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727318.772076:0:9620:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00000100:00100000:0.0:1782727319.004086:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727319.004142:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893560704 00000100:00100000:0.0:1782727319.004145:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727319.004158:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893560704 00000100:00100000:3.0:1782727319.004246:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 198 00000100:00100000:3.0:1782727319.004269:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893560704:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727319.004365:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893560704:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 108us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727319.004374:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 198 00000100:00100000:2.0:1782727319.005894:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893560832 00000100:00100000:2.0:1782727319.005910:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893560832 00000100:00100000:2.0:1782727319.006012:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:2.0:1782727319.006024:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893560832:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1782727319.006119:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893560832:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 98us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727319.006129:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00080000:2.0:1782727319.006175:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727319.279028:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782727319.540228:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c9ff188-fb9c-4b39-a5ed-2408b1373248 00000020:00000080:3.0:1782727319.540243:0:6933:0:(genops.c:906:class_export_put()) final put ffff8cef7c1ce000/4c9ff188-fb9c-4b39-a5ed-2408b1373248 00000020:00000080:2.0:1782727319.540375:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cef7c1ce000/4c9ff188-fb9c-4b39-a5ed-2408b1373248 for lustre-OST0000 00000020:00000080:2.0:1782727319.540433:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cef7c1c8000 for lustre-OST0000 00000100:00100000:2.0:1782727319.540828:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727319.540853:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912466048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727319.540952:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1782727319.541322:0:8023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c9ff188-fb9c-4b39-a5ed-2408b1373248 00000020:00000080:2.0:1782727319.541326:0:8023:0:(genops.c:906:class_export_put()) final put ffff8cef7c1c9800/4c9ff188-fb9c-4b39-a5ed-2408b1373248 00000100:00100000:0.0:1782727319.541609:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912466048 00000100:00100000:0.0:1782727319.541686:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912466048 00000100:00100000:0.0:1782727319.541759:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727319.541768:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912466048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727319.541862:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727319.542221:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912466048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 453us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727319.542230:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1782727319.542625:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727319.542664:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4a3480 x1869324912466048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727319.542695:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912466048:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1782727319.546825:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8cef7c1c9800/4c9ff188-fb9c-4b39-a5ed-2408b1373248 for lustre-OST0001 00000020:00000080:3.0:1782727319.546879:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cef7c1c9000 for lustre-OST0001 00000100:00100000:3.0:1782727320.047443:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912466304:0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.047542:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727320.047609:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912466816:0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.047634:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727320.047668:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782727320.047674:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912466176:0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.047705:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727320.047727:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912466688:0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.047748:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727320.047774:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912466560:0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.047797:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727320.047816:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727320.047821:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912466432:0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.047843:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727320.047869:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912466816 00000100:00100000:3.0:1782727320.047876:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912466816 00000100:00100000:3.0:1782727320.047924:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912466560 00000100:00100000:3.0:1782727320.047956:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912466560 00000100:00100000:3.0:1782727320.047975:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727320.047982:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912466816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.048035:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912466816:12345-0@lo:400:kworker.0 Request processed in 53us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727320.048043:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727320.048076:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727320.048082:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912466560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.048115:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912466560:12345-0@lo:400:kworker.0 Request processed in 33us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727320.048122:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727320.048140:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912466176 00000100:00100000:3.0:1782727320.048144:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912466176 00000100:00100000:3.0:1782727320.048167:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1782727320.048174:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912466176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.048201:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912466176:12345-0@lo:400:kworker.0 Request processed in 28us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727320.048207:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1782727320.048233:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912466304 00000100:00100000:3.0:1782727320.048237:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912466304 00000100:00100000:3.0:1782727320.048259:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912466688 00000100:00100000:3.0:1782727320.048262:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912466688 00000100:00100000:3.0:1782727320.048288:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912466432 00000100:00100000:3.0:1782727320.048291:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912466432 00000100:00100000:3.0:1782727320.048306:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782727320.048312:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912466304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.048340:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912466304:12345-0@lo:400:kworker.0 Request processed in 28us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727320.048346:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782727320.048356:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727320.048362:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912466688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.048387:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912466688:12345-0@lo:400:kworker.0 Request processed in 25us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727320.048401:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727320.048424:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727320.048430:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912466432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.048458:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912466432:12345-0@lo:400:kworker.0 Request processed in 28us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727320.048464:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727320.048507:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912466432:0@lo:400:kworker.0 00010000:00080000:3.0:1782727320.048521:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e1d9c00 x1869324912466560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727320.048532:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912466560:0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.048561:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912466176:0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.048570:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912466688:0@lo:400:kworker.0 00000100:00100000:3.0:1782727320.048579:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912466304:0@lo:400:kworker.0 00010000:00080000:3.0:1782727320.048589:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e1db100 x1869324912466816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727320.048598:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912466816:0@lo:400:kworker.0 00000100:00080000:2.0:1782727320.049173:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727320.049180:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782727320.303384:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727320.563866:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912466944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727320.564024:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727320.565778:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912466944 00000100:00100000:2.0:1782727320.565798:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912466944 00000100:00100000:2.0:1782727320.565880:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782727320.565891:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912466944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727320.565984:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727320.566089:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912466944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727320.566098:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1782727320.566374:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4a3480 x1869324912466944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727320.566410:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912466944:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1782727321.233902:0:9718:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:1.0:1782727321.328142:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727322.352170:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727323.375616:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727323.855796:0:9816:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00000100:00100000:0.0:1782727324.123512:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727324.123602:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727324.123706:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893561088 00000100:00100000:2.0:1782727324.123716:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893561088 00000100:00100000:2.0:1782727324.123807:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00080000:0.0:1782727324.123809:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727324.123818:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893561088:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1782727324.124621:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893561088:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 800us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727324.124632:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:3.0:1782727324.128922:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893560960 00000100:00100000:3.0:1782727324.128958:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893560960 00000100:00100000:3.0:1782727324.129044:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 200 00000100:00100000:3.0:1782727324.129054:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893560960:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727324.129143:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893560960:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 85us (5636us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727324.129171:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 200 00010000:00010000:1.0:1782727324.399313:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727324.655227:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727324.660112:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912467072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727324.660192:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727324.660295:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912467072 00000100:00100000:2.0:1782727324.660305:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912467072 00000100:00100000:2.0:1782727324.660397:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727324.660407:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912467072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727324.660441:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727324.660495:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912467072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727324.660516:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1782727324.661386:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727324.661782:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4a1f80 x1869324912467072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727324.661806:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912467072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727325.171083:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912467200:0@lo:400:kworker.0 00000100:00100000:3.0:1782727325.171335:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727325.171487:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912467328:0@lo:400:kworker.0 00000100:00100000:2.0:1782727325.171521:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727325.171549:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912467456:0@lo:400:kworker.0 00000100:00100000:2.0:1782727325.171573:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727325.171594:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912467584:0@lo:400:kworker.0 00000100:00100000:2.0:1782727325.171620:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727325.171648:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912467328 00000100:00100000:2.0:1782727325.171655:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912467328 00000100:00100000:2.0:1782727325.171701:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912467456 00000100:00100000:2.0:1782727325.171704:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912467456 00000100:00100000:2.0:1782727325.171738:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782727325.171748:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912467328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727325.171753:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782727325.171767:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912467456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727325.171810:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912467328:12345-0@lo:400:kworker.0 Request processed in 63us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727325.171819:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782727325.171832:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912467456:12345-0@lo:400:kworker.0 Request processed in 68us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727325.171841:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782727325.171854:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912467584 00000100:00100000:2.0:1782727325.171859:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912467584 00000100:00100000:2.0:1782727325.171888:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782727325.171895:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912467584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727325.171958:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912467584:12345-0@lo:400:kworker.0 Request processed in 63us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727325.171965:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1782727325.171982:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727325.172081:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912467712:0@lo:400:kworker.0 00000100:00100000:3.0:1782727325.172108:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727325.172147:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912467200 00000100:00100000:3.0:1782727325.172150:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912467200 00000100:00100000:3.0:1782727325.172178:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1782727325.172184:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3444:x1869324912467200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727325.172302:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3444:x1869324912467200:12345-0@lo:400:kworker.0 Request processed in 118us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727325.172319:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1782727325.172349:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912467712 00000100:00100000:3.0:1782727325.172353:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912467712 00000100:00080000:1.0:1782727325.172727:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727325.172814:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782727325.172822:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912467712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727325.172859:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912467712:12345-0@lo:400:kworker.0 Request processed in 39us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727325.172866:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782727325.172962:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912467328:0@lo:400:kworker.0 00000100:00100000:2.0:1782727325.172972:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912467840:0@lo:400:kworker.0 00000100:00100000:2.0:1782727325.173010:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727325.173052:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912467840 00000100:00100000:2.0:1782727325.173057:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912467840 00000100:00100000:2.0:1782727325.173087:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782727325.173094:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912467840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727325.173128:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912467840:12345-0@lo:400:kworker.0 Request processed in 35us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727325.173134:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1782727325.173161:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4a1180 x1869324912467840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727325.173171:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912467840:0@lo:400:kworker.0 00000100:00080000:1.0:1782727325.173493:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727325.173533:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912467456:0@lo:400:kworker.0 00010000:00080000:2.0:1782727325.173604:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4a0e00 x1869324912467584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727325.173615:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912467584:0@lo:400:kworker.0 00000100:00100000:3.0:1782727325.173760:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912467712:0@lo:400:kworker.0 00000100:00100000:3.0:1782727325.173772:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912467200:0@lo:400:kworker.0 00010000:00010000:0.0:1782727325.424387:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727325.449628:0:9864:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Mon Jun 29 06:02:03 EDT 2026 00000100:00100000:1.0:1782727325.679498:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912467968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727325.679586:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727325.684770:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912467968 00000100:00100000:0.0:1782727325.684786:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912467968 00000100:00100000:0.0:1782727325.684865:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727325.684876:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912467968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727325.684916:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727325.685040:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912467968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (5454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727325.685048:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1782727325.685192:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4a0e00 x1869324912467968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727325.685212:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912467968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782727326.448719:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727327.471186:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727328.500111:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727329.255323:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727329.255410:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727329.255526:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893561344 00000100:00100000:1.0:1782727329.255536:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893561344 00000100:00100000:1.0:1782727329.255614:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:1.0:1782727329.255624:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893561344:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727329.255715:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893561344:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727329.255723:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00080000:3.0:1782727329.256707:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727329.258371:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893561216 00000100:00100000:2.0:1782727329.258385:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893561216 00000100:00100000:2.0:1782727329.258461:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 202 00000100:00100000:2.0:1782727329.258483:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893561216:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1782727329.258574:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893561216:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 105us (3260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727329.258582:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 202 00010000:00010000:2.0:1782727329.519404:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727329.776015:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727329.776039:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912468096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727329.776113:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727329.776230:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912468096 00000100:00100000:1.0:1782727329.776238:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912468096 00000100:00100000:1.0:1782727329.776298:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727329.776308:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912468096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727329.776345:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727329.776391:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912468096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727329.776399:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1782727329.776422:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782727329.776459:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4a1180 x1869324912468096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727329.776477:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912468096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727330.287093:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912468480:0@lo:400:kworker.0 00000100:00100000:2.0:1782727330.287116:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912468352:0@lo:400:kworker.0 00000100:00100000:1.0:1782727330.287166:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727330.287234:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727330.287240:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912468608:0@lo:400:kworker.0 00000100:00100000:1.0:1782727330.287270:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727330.287319:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912468480 00000100:00100000:1.0:1782727330.287327:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912468480 00000100:00100000:2.0:1782727330.287359:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727330.287386:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912468864:0@lo:400:kworker.0 00000100:00100000:1.0:1782727330.287393:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912468352 00000100:00100000:1.0:1782727330.287398:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912468352 00000100:00100000:2.0:1782727330.287422:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727330.287431:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782727330.287442:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912468480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727330.287472:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782727330.287482:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912468224:0@lo:400:kworker.0 00000100:00100000:1.0:1782727330.287506:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912468480:12345-0@lo:400:kworker.0 Request processed in 65us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727330.287515:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782727330.287532:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727330.287540:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782727330.287548:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912468352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727330.287563:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912468736:0@lo:400:kworker.0 00000100:00100000:1.0:1782727330.287588:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912468352:12345-0@lo:400:kworker.0 Request processed in 40us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727330.287600:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782727330.287603:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727330.287618:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912468736 00000100:00100000:1.0:1782727330.287623:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912468736 00000100:00100000:1.0:1782727330.287645:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782727330.287652:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912468736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727330.287686:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912468736:12345-0@lo:400:kworker.0 Request processed in 35us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727330.287693:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782727330.287713:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912468608 00000100:00100000:1.0:1782727330.287716:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912468608 00000100:00100000:1.0:1782727330.287740:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912468864 00000100:00100000:1.0:1782727330.287743:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912468864 00000100:00100000:1.0:1782727330.287761:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782727330.287769:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912468608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727330.287801:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912468608:12345-0@lo:400:kworker.0 Request processed in 34us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727330.287817:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782727330.287828:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727330.287834:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912468864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727330.287865:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912468864:12345-0@lo:400:kworker.0 Request processed in 31us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727330.287871:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782727330.287879:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912468352:0@lo:400:kworker.0 00000100:00080000:1.0:1782727330.287888:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727330.287895:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782727330.287905:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4a2a00 x1869324912468864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727330.287919:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912468864:0@lo:400:kworker.0 00010000:00080000:1.0:1782727330.287950:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4a1180 x1869324912468608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727330.287962:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912468608:0@lo:400:kworker.0 00000100:00100000:1.0:1782727330.287978:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912468480:0@lo:400:kworker.0 00000100:00100000:2.0:1782727330.288029:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912468736:0@lo:400:kworker.0 00000100:00100000:3.0:1782727330.289283:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912468224 00000100:00100000:3.0:1782727330.289292:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912468224 00000100:00100000:3.0:1782727330.289388:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782727330.289399:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912468224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727330.289474:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912468224:12345-0@lo:400:kworker.0 Request processed in 78us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727330.289482:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1782727330.289578:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912468224:0@lo:400:kworker.0 00010000:00010000:0.0:1782727330.544996:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727330.805745:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912468992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727330.805828:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727330.805959:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912468992 00000100:00100000:0.0:1782727330.805968:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912468992 00000100:00100000:0.0:1782727330.806022:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782727330.806033:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912468992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727330.806063:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727330.806116:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912468992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727330.806123:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1782727330.806238:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f30000 x1869324912468992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727330.806270:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912468992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782727331.567240:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727332.591550:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727333.624818:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727334.361973:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727334.362028:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727334.362063:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893561600 00000100:00100000:1.0:1782727334.362074:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893561600 00000100:00100000:1.0:1782727334.362165:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:1.0:1782727334.362176:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893561600:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727334.362289:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893561600:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 114us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727334.362297:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00080000:1.0:1782727334.362324:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727334.363423:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893561472 00000100:00100000:3.0:1782727334.363436:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893561472 00000100:00100000:3.0:1782727334.363509:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 204 00000100:00100000:3.0:1782727334.363520:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893561472:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727334.363712:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893561472:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 193us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727334.363721:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 204 00010000:00010000:2.0:1782727334.643269:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727334.896685:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912469120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727334.896788:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727334.896893:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912469120 00000100:00100000:2.0:1782727334.896902:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912469120 00000100:00100000:2.0:1782727334.897000:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782727334.897013:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912469120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727334.897052:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727334.897127:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912469120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727334.897137:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1782727334.897176:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727334.897215:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f30380 x1869324912469120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727334.897238:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912469120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727335.408462:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912469504:0@lo:400:kworker.0 00000100:00100000:1.0:1782727335.408582:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727335.408663:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727335.408670:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912469632:0@lo:400:kworker.0 00000100:00100000:1.0:1782727335.408695:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727335.408742:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912469504 00000100:00100000:1.0:1782727335.408753:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912469504 00000100:00100000:1.0:1782727335.408822:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912469632 00000100:00100000:1.0:1782727335.408826:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912469632 00000100:00100000:1.0:1782727335.408852:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782727335.408862:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912469504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727335.408957:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912469504:12345-0@lo:400:kworker.0 Request processed in 95us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727335.408965:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782727335.408989:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782727335.408995:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912469632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727335.409143:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912469248:0@lo:400:kworker.0 00000100:00100000:3.0:1782727335.409201:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727335.409228:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912469760:0@lo:400:kworker.0 00000100:00100000:3.0:1782727335.409256:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727335.409276:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727335.409282:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912469376:0@lo:400:kworker.0 00000100:00100000:3.0:1782727335.409305:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727335.409326:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912469248 00000100:00100000:3.0:1782727335.409330:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912469248 00000100:00100000:3.0:1782727335.409361:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782727335.409367:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3444:x1869324912469248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727335.409405:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3444:x1869324912469248:12345-0@lo:400:kworker.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727335.409413:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782727335.409448:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912469760 00000100:00100000:3.0:1782727335.409451:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912469760 00000100:00100000:3.0:1782727335.409482:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782727335.409488:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912469760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727335.409521:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912469760:12345-0@lo:400:kworker.0 Request processed in 33us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727335.409527:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782727335.409576:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912469248:0@lo:400:kworker.0 00010000:00080000:3.0:1782727335.409591:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e1dad80 x1869324912469760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727335.409604:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912469760:0@lo:400:kworker.0 00000100:00080000:3.0:1782727335.409657:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727335.409670:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727335.409681:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912469376 00000100:00100000:3.0:1782727335.409685:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912469376 00000100:00100000:3.0:1782727335.409705:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782727335.409712:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912469376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727335.409750:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912469376:12345-0@lo:400:kworker.0 Request processed in 38us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727335.409757:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782727335.409781:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912469376:0@lo:400:kworker.0 00000100:00100000:0.0:1782727335.410126:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912469504:0@lo:400:kworker.0 00000100:00100000:1.0:1782727335.411633:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912469632:12345-0@lo:400:kworker.0 Request processed in 2627us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727335.411648:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782727335.413560:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912469632:0@lo:400:kworker.0 00010000:00010000:0.0:1782727335.664115:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727335.920403:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912469888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727335.920513:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727335.920875:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912469888 00000100:00100000:3.0:1782727335.920886:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912469888 00000100:00100000:3.0:1782727335.920992:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782727335.921004:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912469888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727335.921043:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727335.921722:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912469888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 717us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727335.921731:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1782727335.927602:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f33800 x1869324912469888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727335.927642:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912469888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727336.694944:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727337.713806:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727338.738137:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727339.485068:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727339.485119:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727339.485271:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893561856 00000100:00100000:3.0:1782727339.485283:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893561856 00000100:00100000:2.0:1782727339.485293:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893561728 00000100:00100000:2.0:1782727339.485300:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893561728 00000100:00100000:2.0:1782727339.485370:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 206 00000100:00100000:2.0:1782727339.485383:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893561728:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727339.485397:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:3.0:1782727339.485407:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893561856:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727339.485475:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893561856:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 70us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727339.485484:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:2.0:1782727339.485495:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893561728:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 114us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727339.485504:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 206 00000100:00080000:0.0:1782727339.488216:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727339.759254:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727340.019488:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912470016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727340.019567:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727340.019681:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912470016 00000100:00100000:0.0:1782727340.019690:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912470016 00000100:00100000:0.0:1782727340.019759:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727340.019769:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912470016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727340.019802:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727340.019860:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912470016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727340.019868:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1782727340.019923:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727340.019964:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f32d80 x1869324912470016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727340.019998:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912470016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727340.528274:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912470528:0@lo:400:kworker.0 00000100:00100000:0.0:1782727340.528359:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727340.528418:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782727340.528425:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912470144:0@lo:400:kworker.0 00000100:00100000:0.0:1782727340.528453:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727340.528475:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912470656:0@lo:400:kworker.0 00000100:00100000:0.0:1782727340.528497:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727340.528531:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912470272:0@lo:400:kworker.0 00000100:00100000:0.0:1782727340.529998:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727340.530063:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727340.530075:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912470400:0@lo:400:kworker.0 00000100:00100000:0.0:1782727340.530106:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727340.530146:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912470528 00000100:00100000:0.0:1782727340.530153:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912470528 00000100:00100000:0.0:1782727340.530204:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912470272 00000100:00100000:0.0:1782727340.530207:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912470272 00000100:00100000:0.0:1782727340.530228:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912470400 00000100:00100000:0.0:1782727340.530230:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912470400 00000100:00100000:0.0:1782727340.530249:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782727340.530256:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912470528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727340.530315:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912470528:12345-0@lo:400:kworker.0 Request processed in 58us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727340.530322:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782727340.530341:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782727340.530347:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912470272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727340.530377:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912470272:12345-0@lo:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727340.530383:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782727340.530393:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782727340.530398:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912470400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727340.530422:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912470400:12345-0@lo:400:kworker.0 Request processed in 23us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727340.530428:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782727340.530472:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912470528:0@lo:400:kworker.0 00000100:00100000:0.0:1782727340.530519:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912470400:0@lo:400:kworker.0 00000100:00100000:0.0:1782727340.530528:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912470272:0@lo:400:kworker.0 00000100:00100000:3.0:1782727340.530714:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912470144 00000100:00100000:3.0:1782727340.530719:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912470144 00000100:00100000:3.0:1782727340.530764:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1782727340.530772:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3446:x1869324912470144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727340.530817:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3446:x1869324912470144:12345-0@lo:400:kworker.0 Request processed in 46us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727340.530823:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1782727340.530867:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912470144:0@lo:400:kworker.0 00000100:00080000:1.0:1782727340.531037:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727340.531385:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912470656 00000100:00100000:2.0:1782727340.531391:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912470656 00000100:00100000:2.0:1782727340.531439:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782727340.531446:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912470656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727340.531496:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912470656:12345-0@lo:400:kworker.0 Request processed in 51us (2997us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727340.531512:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1782727340.531543:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4d8e00 x1869324912470656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727340.531554:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912470656:0@lo:400:kworker.0 00000100:00080000:1.0:1782727340.531658:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782727340.787430:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727341.039329:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727341.040364:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912470784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727341.040513:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727341.040589:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912470784 00000100:00100000:0.0:1782727341.040598:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912470784 00000100:00100000:0.0:1782727341.040661:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727341.040671:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912470784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727341.040703:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727341.040840:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912470784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727341.040848:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1782727341.040915:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f30380 x1869324912470784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727341.041075:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912470784:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727341.807307:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727342.832323:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727343.105397:0:10591:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682451 <= 34618625) for LU-18938, skip 360 00010000:00010000:2.0:1782727343.857103:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727344.588025:0:10640:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682451 < 34486116) for LU-14927, skip 0f 00000100:00100000:3.0:1782727344.604509:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727344.604579:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893561984 00000100:00100000:3.0:1782727344.604599:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727344.604605:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893561984 00000100:00100000:0.0:1782727344.604702:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893562112 00000100:00100000:0.0:1782727344.604707:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893562112 00000100:00100000:0.0:1782727344.604872:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:0.0:1782727344.604888:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893562112:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727344.605032:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893562112:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 147us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727344.605041:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00080000:2.0:1782727344.605196:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727344.607796:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 208 00000100:00100000:1.0:1782727344.607818:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893561984:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727344.607955:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893561984:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 144us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727344.610350:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 208 00010000:00010000:1.0:1782727344.880443:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727345.136530:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727345.136561:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912470912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727345.136815:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727345.137216:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912470912 00000100:00100000:3.0:1782727345.137227:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912470912 00000100:00100000:3.0:1782727345.137312:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782727345.137323:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912470912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727345.137359:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727345.137435:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912470912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727345.137443:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1782727345.137485:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f30000 x1869324912470912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727345.137504:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912470912:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782727345.137652:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727345.648748:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912471040:0@lo:400:kworker.0 00000100:00100000:3.0:1782727345.648885:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912471168:0@lo:400:kworker.0 00000100:00100000:3.0:1782727345.648998:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727345.649079:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912471296:0@lo:400:kworker.0 00000100:00100000:3.0:1782727345.649106:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727345.649132:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727345.649138:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912471424:0@lo:400:kworker.0 00000100:00100000:3.0:1782727345.649183:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727345.649223:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912471168 00000100:00100000:3.0:1782727345.649233:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912471168 00000100:00100000:3.0:1782727345.649288:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912471296 00000100:00100000:3.0:1782727345.649291:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912471296 00000100:00100000:3.0:1782727345.649316:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912471424 00000100:00100000:3.0:1782727345.649320:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912471424 00000100:00100000:3.0:1782727345.649340:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782727345.649349:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912471168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727345.649414:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912471168:12345-0@lo:400:kworker.0 Request processed in 65us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727345.649422:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782727345.649441:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782727345.649447:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912471296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727345.649478:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912471296:12345-0@lo:400:kworker.0 Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727345.649484:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782727345.649501:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782727345.649508:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912471424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727345.649535:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912471424:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727345.649548:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782727345.649598:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912471424:0@lo:400:kworker.0 00000100:00100000:3.0:1782727345.649609:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912471296:0@lo:400:kworker.0 00000100:00100000:3.0:1782727345.649645:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912471168:0@lo:400:kworker.0 00000100:00100000:2.0:1782727345.649892:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727345.649950:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912471552:0@lo:400:kworker.0 00000100:00100000:2.0:1782727345.649981:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727345.650024:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912471552 00000100:00100000:2.0:1782727345.650029:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912471552 00000100:00100000:2.0:1782727345.650064:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782727345.650070:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912471552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727345.650108:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912471552:12345-0@lo:400:kworker.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727345.650116:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1782727345.650151:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4a1180 x1869324912471552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727345.650163:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912471552:0@lo:400:kworker.0 00000100:00100000:0.0:1782727345.650251:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912471040 00000100:00100000:0.0:1782727345.650255:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912471040 00000100:00100000:0.0:1782727345.650296:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1782727345.650303:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3446:x1869324912471040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727345.650345:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3446:x1869324912471040:12345-0@lo:400:kworker.0 Request processed in 43us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727345.650358:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1782727345.650393:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912471040:0@lo:400:kworker.0 00000100:00080000:1.0:1782727345.651005:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727345.651012:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727345.904356:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727345.955279:0:10688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682451 < 34681754) for LU-12550, skip 216 00000100:00100000:2.0:1782727346.160070:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727346.160095:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912471680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727346.160193:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727346.160755:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912471680 00000100:00100000:3.0:1782727346.160764:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912471680 00000100:00100000:3.0:1782727346.160822:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727346.160832:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912471680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727346.160864:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727346.161016:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912471680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727346.161025:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1782727346.161157:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f30000 x1869324912471680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727346.161177:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912471680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727346.927366:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727347.445916:0:10736:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 00010000:00010000:1.0:1782727347.951227:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727348.968399:0:10784:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51c 51e 834 00010000:00010000:0.0:1782727348.975110:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727349.733320:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727349.735034:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727349.735077:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893562368 00000100:00100000:2.0:1782727349.735087:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893562368 00000100:00100000:2.0:1782727349.735146:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:2.0:1782727349.735155:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893562368:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1782727349.735239:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893562368:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 85us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727349.735246:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00080000:2.0:1782727349.735267:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727349.738334:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893562240 00000100:00100000:3.0:1782727349.738350:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893562240 00000100:00100000:3.0:1782727349.738438:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 210 00000100:00100000:3.0:1782727349.738449:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893562240:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727349.738536:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893562240:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 89us (5225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727349.738545:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 210 00010000:00010000:2.0:1782727349.999607:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727350.255305:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727350.255484:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912471808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727350.255617:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727350.255701:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912471808 00000100:00100000:1.0:1782727350.255714:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912471808 00000100:00100000:1.0:1782727350.255852:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782727350.255863:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912471808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727350.255895:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727350.256013:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912471808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727350.256021:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1782727350.256077:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f53480 x1869324912471808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727350.256096:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912471808:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782727350.257102:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1782727350.410453:0:10832:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 06:02:28 (1782727348) === 00000100:00100000:3.0:1782727350.767278:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912472192:0@lo:400:kworker.0 00000100:00100000:2.0:1782727350.767449:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912472064:0@lo:400:kworker.0 00000100:00100000:2.0:1782727350.767508:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727350.767607:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912472064 00000100:00100000:2.0:1782727350.767613:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912472064 00000100:00100000:2.0:1782727350.767679:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782727350.767689:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912472064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727350.767743:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912472064:12345-0@lo:400:kworker.0 Request processed in 55us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727350.767749:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782727350.767793:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912472064:0@lo:400:kworker.0 00000100:00100000:1.0:1782727350.767905:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912471936:0@lo:400:kworker.0 00000100:00100000:1.0:1782727350.767974:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727350.767996:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912472448:0@lo:400:kworker.0 00000100:00100000:1.0:1782727350.768019:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727350.768040:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727350.768045:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912472320:0@lo:400:kworker.0 00000100:00100000:1.0:1782727350.768066:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727350.768092:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912472448 00000100:00100000:1.0:1782727350.768096:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912472448 00000100:00100000:1.0:1782727350.768134:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782727350.768140:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912472448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727350.768175:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912472448:12345-0@lo:400:kworker.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727350.768181:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782727350.768198:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912472320 00000100:00100000:1.0:1782727350.768201:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912472320 00000100:00100000:1.0:1782727350.768224:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782727350.768230:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912472320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727350.768257:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912472320:12345-0@lo:400:kworker.0 Request processed in 27us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727350.768263:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1782727350.768277:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727350.768282:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727350.768301:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912472320:0@lo:400:kworker.0 00010000:00080000:1.0:1782727350.768398:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f51500 x1869324912472448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727350.768424:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912472448:0@lo:400:kworker.0 00000100:00100000:2.0:1782727350.768649:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912471936 00000100:00100000:2.0:1782727350.768654:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912471936 00000100:00100000:2.0:1782727350.768693:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1782727350.768700:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912471936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727350.768747:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912471936:12345-0@lo:400:kworker.0 Request processed in 48us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727350.768755:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1782727350.768800:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727350.768892:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912472192 00000100:00100000:0.0:1782727350.768897:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912472192 00000100:00100000:0.0:1782727350.768963:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782727350.768970:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912472192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727350.769006:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912472192:12345-0@lo:400:kworker.0 Request processed in 37us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727350.769013:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1782727350.769113:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727350.769138:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912472192:0@lo:400:kworker.0 00000100:00100000:1.0:1782727350.769210:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912471936:0@lo:400:kworker.0 00010000:00010000:1.0:1782727351.023515:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727351.281750:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912472576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727351.281837:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727351.281954:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912472576 00000100:00100000:3.0:1782727351.281963:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912472576 00000100:00100000:2.0:1782727351.286762:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782727351.286790:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912472576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727351.286841:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727351.286954:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912472576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (5116us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727351.286963:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1782727351.286992:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f30380 x1869324912472576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727351.287013:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912472576:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782727352.047130:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727353.072290:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727354.098488:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727354.850322:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727354.850374:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727354.850427:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893562624 00000100:00100000:2.0:1782727354.850437:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893562624 00000100:00100000:2.0:1782727354.850500:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:2.0:1782727354.850509:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893562624:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1782727354.850585:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893562624:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727354.850593:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00080000:2.0:1782727354.850615:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727354.850831:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893562496 00000100:00100000:0.0:1782727354.850835:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893562496 00000100:00100000:0.0:1782727354.850874:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 212 00000100:00100000:0.0:1782727354.850882:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893562496:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727354.850916:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893562496:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 35us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727354.850922:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 212 00010000:00010000:2.0:1782727355.119223:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727355.376497:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727355.376530:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912472704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727355.376600:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727355.376958:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912472704 00000100:00100000:3.0:1782727355.376966:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912472704 00000100:00100000:3.0:1782727355.377045:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727355.377056:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912472704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727355.377086:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727355.377151:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912472704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727355.377160:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1782727355.377245:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f52300 x1869324912472704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727355.377263:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912472704:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782727355.377459:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727355.889493:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912472960:0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.889576:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727355.889628:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912473472:0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.889653:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727355.889685:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782727355.889691:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912472832:0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.889734:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727355.889753:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912473344:0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.889790:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727355.889816:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912473088:0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.889838:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727355.889856:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727355.889862:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912473216:0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.889882:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727355.889910:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912472960 00000100:00100000:0.0:1782727355.889917:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912472960 00000100:00100000:0.0:1782727355.889998:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912473344 00000100:00100000:0.0:1782727355.890002:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912473344 00000100:00100000:0.0:1782727355.890024:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912473088 00000100:00100000:0.0:1782727355.890027:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912473088 00000100:00100000:0.0:1782727355.890044:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782727355.890052:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912472960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.890099:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912472960:12345-0@lo:400:kworker.0 Request processed in 47us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727355.890106:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782727355.890122:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782727355.890127:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912473344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.890163:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912473344:12345-0@lo:400:kworker.0 Request processed in 36us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727355.890169:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782727355.890178:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782727355.890184:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912473088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.890211:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912473088:12345-0@lo:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727355.890217:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782727355.890234:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912473472 00000100:00100000:0.0:1782727355.890237:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912473472 00000100:00100000:0.0:1782727355.890261:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912473216 00000100:00100000:0.0:1782727355.890264:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912473216 00000100:00100000:0.0:1782727355.890277:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727355.890283:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912473472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.890312:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912473472:12345-0@lo:400:kworker.0 Request processed in 29us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727355.890318:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727355.890328:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727355.890334:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912473216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.890359:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912473216:12345-0@lo:400:kworker.0 Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727355.890364:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1782727355.890395:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727355.890400:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727355.890423:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e1dad80 x1869324912473216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727355.890447:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912473216:0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.890462:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912473088:0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.890499:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912473344:0@lo:400:kworker.0 00000100:00100000:0.0:1782727355.890508:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912472960:0@lo:400:kworker.0 00010000:00080000:0.0:1782727355.890518:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4d7480 x1869324912473472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727355.890526:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912473472:0@lo:400:kworker.0 00000100:00100000:3.0:1782727355.890801:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912472832 00000100:00100000:3.0:1782727355.890806:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912472832 00000100:00100000:3.0:1782727355.890846:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1782727355.890853:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912472832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727355.890897:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912472832:12345-0@lo:400:kworker.0 Request processed in 44us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727355.890903:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1782727355.890951:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912472832:0@lo:400:kworker.0 00010000:00010000:2.0:1782727356.143142:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727356.399479:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912473600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727356.399551:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727356.399634:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912473600 00000100:00100000:3.0:1782727356.399642:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912473600 00000100:00100000:3.0:1782727356.399705:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782727356.399715:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912473600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727356.399744:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727356.402584:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912473600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2861us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727356.402599:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1782727356.403212:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4d7480 x1869324912473600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727356.403236:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912473600:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1782727356.497132:0:11025:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1782727357.171218:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727358.199048:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727359.227219:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727359.962228:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727359.962281:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727359.962382:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893562880 00000100:00100000:0.0:1782727359.962392:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893562880 00000100:00100000:0.0:1782727359.962478:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:0.0:1782727359.962488:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893562880:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727359.962560:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893562880:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 74us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727359.962567:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:3.0:1782727359.962818:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893562752 00000100:00100000:3.0:1782727359.962823:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893562752 00000100:00100000:3.0:1782727359.962863:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 214 00000100:00100000:3.0:1782727359.962871:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893562752:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727359.962905:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893562752:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 37us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727359.962911:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 214 00000100:00080000:2.0:1782727359.963207:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727360.242458:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727360.497998:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912473728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727360.498114:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727360.499112:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912473728 00000100:00100000:0.0:1782727360.499128:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912473728 00000100:00100000:0.0:1782727360.499208:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782727360.499227:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912473728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727360.499272:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727360.499346:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912473728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727360.499354:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1782727360.499407:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6f480 x1869324912473728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727360.499431:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912473728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782727360.500324:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727361.007336:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912474240:0@lo:400:kworker.0 00000100:00100000:1.0:1782727361.007341:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912473984:0@lo:400:kworker.0 00000100:00100000:2.0:1782727361.007421:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912474112:0@lo:400:kworker.0 00000100:00100000:3.0:1782727361.007489:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912473856:0@lo:400:kworker.0 00000100:00100000:0.0:1782727361.008755:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727361.008876:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912474240 00000100:00100000:0.0:1782727361.008887:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912474240 00000100:00100000:0.0:1782727361.008968:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782727361.008980:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912474240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727361.009059:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912474240:12345-0@lo:400:kworker.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727361.009067:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1782727361.009123:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4d6680 x1869324912474240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727361.009140:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912474240:0@lo:400:kworker.0 00000100:00100000:1.0:1782727361.012664:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727361.012787:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912474496:0@lo:400:kworker.0 00000100:00100000:1.0:1782727361.012843:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727361.012876:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912474496 00000100:00100000:1.0:1782727361.012885:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912474496 00000100:00100000:1.0:1782727361.012989:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782727361.013000:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912474496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727361.013077:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912474496:12345-0@lo:400:kworker.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727361.013086:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1782727361.013116:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782727361.013285:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4d4000 x1869324912474496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727361.013303:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727361.013307:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912474496:0@lo:400:kworker.0 00000100:00100000:3.0:1782727361.013349:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912473856 00000100:00100000:3.0:1782727361.013355:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912473856 00000100:00100000:3.0:1782727361.013462:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1782727361.013472:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3444:x1869324912473856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727361.013511:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3444:x1869324912473856:12345-0@lo:400:kworker.0 Request processed in 42us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727361.013516:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782727361.013587:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727361.013708:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912473984 00000100:00100000:2.0:1782727361.013714:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912473984 00000100:00100000:2.0:1782727361.013747:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912474112 00000100:00100000:2.0:1782727361.013750:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912474112 00000100:00100000:2.0:1782727361.013774:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782727361.013781:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912473984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727361.013855:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912473984:12345-0@lo:400:kworker.0 Request processed in 74us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727361.013861:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782727361.013874:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782727361.013880:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912474112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727361.013910:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912474112:12345-0@lo:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727361.013915:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782727361.013973:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912473856:0@lo:400:kworker.0 00000100:00100000:2.0:1782727361.013983:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912474368:0@lo:400:kworker.0 00000100:00100000:2.0:1782727361.014010:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727361.014028:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912474368 00000100:00100000:2.0:1782727361.014031:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912474368 00000100:00100000:2.0:1782727361.014054:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782727361.014073:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912474368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727361.014103:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912474368:12345-0@lo:400:kworker.0 Request processed in 43us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727361.014108:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782727361.014135:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912474368:0@lo:400:kworker.0 00000100:00080000:1.0:1782727361.017076:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727361.017532:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912474112:0@lo:400:kworker.0 00000100:00100000:1.0:1782727361.017736:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912473984:0@lo:400:kworker.0 00010000:00010000:2.0:1782727361.268102:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727361.519182:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912474624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727361.519296:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727361.522980:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912474624 00000100:00100000:2.0:1782727361.523002:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912474624 00000100:00100000:2.0:1782727361.523080:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782727361.523093:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912474624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727361.523142:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727361.523275:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912474624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (3979us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727361.523283:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1782727361.523400:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6f480 x1869324912474624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727361.523427:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912474624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727362.287224:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727363.313816:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727363.445794:0:11287:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727363.446060:0:11287:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782727364.336228:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727365.089340:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727365.089390:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727365.089432:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893563136 00000100:00100000:0.0:1782727365.089443:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893563136 00000100:00100000:0.0:1782727365.089509:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:0.0:1782727365.089519:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2339:x1869324893563136:12345-192.168.204.23@tcp:400:kworker.0 00000100:00080000:1.0:1782727365.089902:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727365.091985:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2339:x1869324893563136:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 2457us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727365.092003:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:0.0:1782727365.092066:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893563008 00000100:00100000:0.0:1782727365.092074:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893563008 00000100:00100000:0.0:1782727365.092117:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 216 00000100:00100000:0.0:1782727365.092126:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2339:x1869324893563008:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727365.092192:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2339:x1869324893563008:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 67us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727365.092199:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 216 00010000:00010000:0.0:1782727365.360425:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727365.417788:0:11384:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727365.418147:0:11384:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782727365.624200:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912474752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727365.624276:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727365.626684:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912474752 00000100:00100000:2.0:1782727365.626698:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912474752 00000100:00100000:2.0:1782727365.626770:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782727365.626781:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912474752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727365.626816:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727365.626895:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912474752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (2619us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727365.626903:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1782727365.627194:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6f480 x1869324912474752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727365.627216:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912474752:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782727365.630705:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727366.130400:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912475136:0@lo:400:kworker.0 00000100:00100000:3.0:1782727366.130489:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727366.130622:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727366.130629:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912475264:0@lo:400:kworker.0 00000100:00100000:3.0:1782727366.130658:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727366.130709:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912475264 00000100:00100000:3.0:1782727366.130717:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912475264 00000100:00100000:3.0:1782727366.130763:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782727366.130772:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912475264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727366.130837:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912475264:12345-0@lo:400:kworker.0 Request processed in 65us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727366.130845:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1782727366.130885:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f50700 x1869324912475264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727366.130898:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912475264:0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.131469:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912475008:0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.131515:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727366.131544:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912475520:0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.131697:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727366.131730:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782727366.131736:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912474880:0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.131765:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727366.131785:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912475392:0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.131806:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727366.131835:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912475520 00000100:00100000:1.0:1782727366.131839:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912475520 00000100:00100000:1.0:1782727366.131874:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782727366.131882:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912475520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.131920:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912475520:12345-0@lo:400:kworker.0 Request processed in 39us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727366.131943:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782727366.131976:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912475136 00000100:00100000:1.0:1782727366.131979:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912475136 00000100:00100000:1.0:1782727366.132006:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912475008 00000100:00100000:1.0:1782727366.132009:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912475008 00000100:00100000:1.0:1782727366.132019:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912475392 00000100:00100000:1.0:1782727366.132021:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912475392 00000100:00100000:1.0:1782727366.132034:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782727366.132040:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912475136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.132076:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912475136:12345-0@lo:400:kworker.0 Request processed in 36us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727366.132082:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782727366.132093:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782727366.132099:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912475008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.132141:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912475008:12345-0@lo:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727366.132148:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782727366.132160:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782727366.132209:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912474880 00000100:00100000:3.0:1782727366.132213:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912474880 00000100:00100000:3.0:1782727366.132242:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1782727366.132248:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912474880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727366.132280:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912474880:12345-0@lo:400:kworker.0 Request processed in 31us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727366.132286:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:3.0:1782727366.132308:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727366.132312:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727366.132361:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912475136:0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.132685:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912475392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.132721:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912475392:12345-0@lo:400:kworker.0 Request processed in 555us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727366.132727:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782727366.132764:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912474880:0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.132773:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912475392:0@lo:400:kworker.0 00000100:00100000:1.0:1782727366.132784:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912475008:0@lo:400:kworker.0 00010000:00080000:1.0:1782727366.132794:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f50380 x1869324912475520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727366.132815:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912475520:0@lo:400:kworker.0 00010000:00010000:0.0:1782727366.386771:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727366.643043:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912475648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727366.643133:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727366.644509:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912475648 00000100:00100000:2.0:1782727366.644524:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912475648 00000100:00100000:2.0:1782727366.644595:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782727366.644606:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912475648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727366.644641:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727366.644852:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912475648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 246us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727366.644861:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1782727366.644972:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f6f480 x1869324912475648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727366.644993:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912475648:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727367.407693:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782727367.881574:0:11482:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727367.887948:0:11482:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782727368.431854:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727369.455835:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727370.201898:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727370.201983:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893563264 00000100:00100000:2.0:1782727370.201994:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727370.201997:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893563264 00000100:00100000:3.0:1782727370.202066:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893563392 00000100:00100000:3.0:1782727370.202072:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893563392 00000100:00100000:0.0:1782727370.202083:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 218 00000100:00100000:0.0:1782727370.202097:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893563264:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727370.202138:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:3.0:1782727370.202150:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893563392:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727370.202185:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893563264:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 92us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727370.202194:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 218 00000100:00100000:3.0:1782727370.202214:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893563392:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727370.202222:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00080000:3.0:1782727370.202245:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:1.0:1782727370.330219:0:11579:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727370.330647:0:11579:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782727370.479127:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727370.735475:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e55bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912475776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727370.735584:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727370.735749:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912475776 00000100:00100000:2.0:1782727370.735761:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912475776 00000100:00100000:2.0:1782727370.735844:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782727370.735862:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912475776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727370.735904:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727370.735988:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912475776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727370.735996:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1782727370.736086:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782727370.736123:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e55bb80 x1869324912475776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727370.736145:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e55bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912475776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727371.248114:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912476288:0@lo:400:kworker.0 00000100:00100000:0.0:1782727371.248211:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727371.248288:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727371.248295:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912476160:0@lo:400:kworker.0 00000100:00100000:0.0:1782727371.248326:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727371.248415:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912476032:0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.248450:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727371.248477:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912476544:0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.248501:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727371.248524:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782727371.248530:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912475904:0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.248563:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727371.248609:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912476416:0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.248634:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727371.248670:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912476288 00000100:00100000:3.0:1782727371.248691:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912476288 00000100:00100000:3.0:1782727371.248748:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912476544 00000100:00100000:3.0:1782727371.248751:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912476544 00000100:00100000:3.0:1782727371.248782:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727371.248792:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912476288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.248860:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912476288:12345-0@lo:400:kworker.0 Request processed in 68us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727371.248867:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727371.248887:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782727371.248893:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912476544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.248924:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912476544:12345-0@lo:400:kworker.0 Request processed in 32us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727371.248957:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782727371.248979:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912475904 00000100:00100000:3.0:1782727371.248982:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912475904 00000100:00100000:3.0:1782727371.249008:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1782727371.249013:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912475904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.249040:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912475904:12345-0@lo:400:kworker.0 Request processed in 26us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727371.249046:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1782727371.249072:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912476160 00000100:00100000:3.0:1782727371.249076:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912476160 00000100:00100000:3.0:1782727371.249099:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912476032 00000100:00100000:3.0:1782727371.249102:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912476032 00000100:00100000:3.0:1782727371.249111:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912476416 00000100:00100000:3.0:1782727371.249113:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912476416 00000100:00100000:3.0:1782727371.249125:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782727371.249130:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912476160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.249170:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912476160:12345-0@lo:400:kworker.0 Request processed in 40us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727371.249176:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782727371.249187:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782727371.249192:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912476032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.249216:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912476032:12345-0@lo:400:kworker.0 Request processed in 25us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727371.249222:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782727371.249232:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782727371.249238:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912476416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.249264:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912476416:12345-0@lo:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727371.249269:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1782727371.249291:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727371.249297:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727371.249340:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912476160:0@lo:400:kworker.0 00010000:00080000:3.0:1782727371.249356:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4d5180 x1869324912476288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727371.249369:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912476288:0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.249400:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912475904:0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.249422:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912476416:0@lo:400:kworker.0 00000100:00100000:3.0:1782727371.249431:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912476032:0@lo:400:kworker.0 00010000:00080000:3.0:1782727371.249440:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4d6300 x1869324912476544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727371.249456:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912476544:0@lo:400:kworker.0 00010000:00010000:2.0:1782727371.504514:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727371.760135:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727371.760184:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912476672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727371.760288:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727371.760535:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912476672 00000100:00100000:2.0:1782727371.760545:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912476672 00000100:00100000:2.0:1782727371.760615:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782727371.760626:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912476672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727371.760666:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727371.760728:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912476672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727371.760736:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1782727371.760788:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e559f80 x1869324912476672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727371.760812:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912476672:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782727372.529871:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727373.554175:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727374.041179:0:11724:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782727374.575232:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727375.327210:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727375.327280:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727375.327388:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893563648 00000100:00100000:0.0:1782727375.327402:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893563648 00000100:00100000:0.0:1782727375.327488:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:0.0:1782727375.327500:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893563648:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727375.327609:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893563648:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 111us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727375.327618:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00080000:0.0:1782727375.327647:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727375.331687:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893563520 00000100:00100000:1.0:1782727375.331703:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893563520 00000100:00100000:1.0:1782727375.331782:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 220 00000100:00100000:1.0:1782727375.331794:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893563520:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727375.331910:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893563520:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 119us (4629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727375.331919:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 220 00010000:00010000:2.0:1782727375.599890:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727375.855240:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912476800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727375.855351:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727375.855675:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912476800 00000100:00100000:3.0:1782727375.855685:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912476800 00000100:00100000:3.0:1782727375.855771:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782727375.855784:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e55aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912476800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727375.855824:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727375.855882:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e55aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912476800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727375.855891:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1782727375.857130:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727375.857187:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f53100 x1869324912476800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727375.857218:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912476800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727376.367141:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727376.368267:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727376.368296:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912477056:0@lo:400:kworker.0 00000100:00100000:1.0:1782727376.368407:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727376.371399:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912477056 00000100:00100000:3.0:1782727376.371419:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912477056 00000100:00100000:3.0:1782727376.371503:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782727376.371517:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912477056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727376.371647:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912477056:12345-0@lo:400:kworker.0 Request processed in 132us (3239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727376.371656:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782727376.371732:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912477056:0@lo:400:kworker.0 00000100:00100000:3.0:1782727376.372780:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912476928:0@lo:400:kworker.0 00000100:00100000:3.0:1782727376.372855:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727376.373462:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912477184:0@lo:400:kworker.0 00000100:00100000:0.0:1782727376.373511:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727376.373539:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727376.373545:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912477312:0@lo:400:kworker.0 00000100:00100000:0.0:1782727376.373585:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727376.373617:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912477184 00000100:00100000:0.0:1782727376.373626:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912477184 00000100:00100000:0.0:1782727376.373684:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912477312 00000100:00100000:0.0:1782727376.373687:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912477312 00000100:00100000:0.0:1782727376.373713:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782727376.373721:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912477184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727376.373777:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912477184:12345-0@lo:400:kworker.0 Request processed in 56us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727376.373785:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782727376.373808:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782727376.373813:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912477312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727376.373841:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912477312:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727376.373846:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782727376.373871:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912477440:0@lo:400:kworker.0 00000100:00100000:0.0:1782727376.373904:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727376.373968:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912477440 00000100:00100000:0.0:1782727376.373972:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912477440 00000100:00100000:0.0:1782727376.374005:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782727376.374012:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912477440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727376.374050:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912477440:12345-0@lo:400:kworker.0 Request processed in 38us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727376.374056:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782727376.374098:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912477312:0@lo:400:kworker.0 00000100:00100000:0.0:1782727376.374111:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912477184:0@lo:400:kworker.0 00010000:00080000:0.0:1782727376.374172:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4d6d80 x1869324912477440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727376.374183:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912477440:0@lo:400:kworker.0 00000100:00100000:2.0:1782727376.376555:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912476928 00000100:00100000:2.0:1782727376.376576:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912476928 00000100:00100000:2.0:1782727376.376651:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1782727376.376664:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912476928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727376.376773:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912476928:12345-0@lo:400:kworker.0 Request processed in 112us (3917us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727376.376781:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:2.0:1782727376.376829:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727376.376835:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727376.378317:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912476928:0@lo:400:kworker.0 00010000:00010000:2.0:1782727376.630138:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727376.881901:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912477568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727376.882030:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727376.882466:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912477568 00000100:00100000:0.0:1782727376.882476:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912477568 00000100:00100000:0.0:1782727376.882545:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782727376.882558:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912477568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727376.882600:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727376.882675:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912477568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727376.882683:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1782727376.882779:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e1db480 x1869324912477568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727376.882804:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912477568:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1782727377.276305:0:11871:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe6677f30 20000000:00000080:1.0:1782727377.276327:0:11871:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cef7e1dc800 uarg=0000000000000000 20000000:01000000:1.0:1782727377.276391:0:11871:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782727377.276397:0:11871:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782727377.276401:0:11871:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782727377.276924:0:11872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1782727377.277182:0:11871:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1782727377.285150:0:11871:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782727377.285274:0:11871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.285320:0:11871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef77da5400/0x9832bf6cd8a42eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42eab expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.285328:0:11871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42eb9 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.285335:0:11871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42ece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42ec7 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.285470:0:11871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cef77da4800/0x9832bf6cd8a42ed5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1e6 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.285478:0:11871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.285522:0:11871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef77da4800/0x9832bf6cd8a42ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1e6 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.285537:0:11871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cef77da4800/0x9832bf6cd8a42ed5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1e6 expref: 9 pid: 5946 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727377.285552:0:11871:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11871:1869324912477696:192.168.204.23@tcp:104: 00010000:00010000:3.0:1782727377.285685:0:11871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42ec7 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.285693:0:11871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42ec7 expref: 18 pid: 5947 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727377.285702:0:11871:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11871:1869324912477824:0@lo:104: 00000100:00100000:3.0:1782727377.285749:0:11871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727377.285786:0:11871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42eb9 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.285795:0:11871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42eb9 expref: 18 pid: 5945 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727377.285802:0:11871:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f52a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11871:1869324912477952:0@lo:104: 00000100:00100000:0.0:1782727377.285804:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912477824 00000100:00100000:0.0:1782727377.285811:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912477824 00000100:00100000:3.0:1782727377.285822:0:11871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727377.285852:0:11871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cef77da5400/0x9832bf6cd8a42eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9832bf6cd8a42eab expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.285860:0:11871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cef77da5400/0x9832bf6cd8a42eb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9832bf6cd8a42eab expref: 18 pid: 5946 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727377.285864:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912477952 00000100:00100000:0.0:1782727377.285867:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912477952 00000100:00100000:3.0:1782727377.285868:0:11871:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f51880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11871:1869324912478080:0@lo:104: 00000100:00100000:0.0:1782727377.285883:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727377.285886:0:11871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727377.285891:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:11871:x1869324912477824:12345-0@lo:104: 00000100:00100000:3.0:1782727377.285896:0:11871:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6da96300 going to sleep for 11 seconds 00010000:00010000:0.0:1782727377.285903:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.286009:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727377.286013:0:8032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912478080 00000100:00100000:3.0:1782727377.286016:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:11871:x1869324912477824:12345-0@lo:104: Request processed in 125us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727377.286017:0:8032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912478080 00000100:00100000:3.0:1782727377.286023:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727377.286034:0:8032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727377.286038:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782727377.286040:0:8032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2c805432-a345-4b8b-859c-fa0b2938956c+4:11871:x1869324912477952:12345-0@lo:104: 00000100:00100000:3.0:1782727377.286044:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:11871:x1869324912478080:12345-0@lo:104: 00010000:00010000:3.0:1782727377.286052:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727377.286053:0:8032:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.286085:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782727377.286090:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c805432-a345-4b8b-859c-fa0b2938956c+4:11871:x1869324912478080:12345-0@lo:104: Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727377.286102:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727377.286131:0:11871:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11871:1869324912477824:0@lo:104: 00000100:00100000:3.0:1782727377.286164:0:11871:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f52a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11871:1869324912477952:0@lo:104: 00000100:00100000:3.0:1782727377.286172:0:11871:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f51880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11871:1869324912478080:0@lo:104: 00010000:00010000:3.0:1782727377.287021:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782727377.287023:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727377.287029:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727377.287029:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.287039:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525600 already unused, calling callback (ffffffffc1462c20) 00010000:00010000:0.0:1782727377.287039:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21a00 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:3.0:1782727377.287043:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727377.287044:0:5939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.287052:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727377.287060:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727377.287061:0:5939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727377.287067:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1782727377.287067:0:5939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727377.287071:0:5939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727377.287117:0:8032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727377.287125:0:8032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2c805432-a345-4b8b-859c-fa0b2938956c+3:11871:x1869324912477952:12345-0@lo:104: Request processed in 1084us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727377.287132:0:8032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1782727377.287204:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.287211:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782727377.287257:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912478208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727377.287319:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727377.287374:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.287382:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef41525600/0x9832bf6cd8a42ec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42ece expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.287395:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727377.287405:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.287411:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da5600 already unused, calling callback (ffffffffc1462c20) 10000000:00010000:3.0:1782727377.287413:0:6954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.287420:0:6954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727377.287425:0:6954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727377.287430:0:6954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1782727377.287508:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912478208 00000100:00100000:1.0:1782727377.287514:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912478208 00010000:00010000:1.0:1782727377.287537:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42ec7 expref: 19 pid: 5947 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727377.287657:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727377.287666:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c965850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3446:x1869324912478208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727377.287678:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727377.287683:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42ec7 expref: 19 pid: 5947 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727377.287692:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42ec7 expref: 19 pid: 5947 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727377.287705:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41524400/0x9832bf6cd8a42ece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42ec7 expref: 19 pid: 5947 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727377.287718:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727377.287751:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c965850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c805432-a345-4b8b-859c-fa0b2938956c+18:3446:x1869324912478208:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727377.287766:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727377.287824:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912478208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782727377.289192:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727377.289452:0:6954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.289463:0:6954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727377.289485:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.289492:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef77da5600/0x9832bf6cd8a42eb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42ec0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.289505:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727377.289506:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727377.289508:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727377.289532:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912478336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782727377.289544:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1782727377.289592:0:5939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727377.289600:0:5939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782727377.289643:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912478464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727377.289647:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727377.289667:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727377.289700:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727377.289707:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff8cef77f21a00/0x9832bf6cd8a42eab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9832bf6cd8a42eb2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727377.289720:0:11871:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11871:1869324912477696:192.168.204.23@tcp:104: 00010000:00010000:0.0:1782727377.289721:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727377.289722:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727377.289724:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727377.289738:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893563776 00000100:00100000:0.0:1782727377.289743:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893563776 00010000:00010000:0.0:1782727377.289766:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef77da4800/0x9832bf6cd8a42ed5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1e6 expref: 10 pid: 5946 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.289769:0:11871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727377.289787:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912478336 00000100:00100000:0.0:1782727377.289790:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912478336 00010000:00010000:0.0:1782727377.289801:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42eb9 expref: 18 pid: 5945 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727377.289813:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912478464 00000100:00100000:3.0:1782727377.289819:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:0.0:1782727377.289821:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912478464 00000100:00100000:3.0:1782727377.289826:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893563776:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727377.289830:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cef77da5400/0x9832bf6cd8a42eb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42eab expref: 19 pid: 5946 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.289837:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782727377.289841:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1782727377.289842:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef77da4800/0x9832bf6cd8a42ed5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1e6 expref: 10 pid: 5946 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727377.289846:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912478336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727377.289852:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef77da4800/0x9832bf6cd8a42ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1e6 expref: 10 pid: 5946 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727377.289853:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727377.289857:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42eb9 expref: 19 pid: 5945 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.289865:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef77da4800/0x9832bf6cd8a42ed5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1e6 expref: 10 pid: 5946 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727377.289866:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42eb9 expref: 19 pid: 5945 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727377.289875:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41525400/0x9832bf6cd8a42ec0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42eb9 expref: 19 pid: 5945 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.289877:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727377.289883:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727377.289913:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:2336:x1869324893563776:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 87us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727377.289916:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c805432-a345-4b8b-859c-fa0b2938956c+18:3447:x1869324912478336:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727377.289921:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:3.0:1782727377.289963:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782727377.289969:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e559500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+18:3444:x1869324912478464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727377.289977:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727377.289981:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cef77da5400/0x9832bf6cd8a42eb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9832bf6cd8a42eab expref: 18 pid: 5946 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.289989:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cef77da5400/0x9832bf6cd8a42eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9832bf6cd8a42eab expref: 18 pid: 5946 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290009:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef77da5400/0x9832bf6cd8a42eb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9832bf6cd8a42eab expref: 18 pid: 5946 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290019:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290027:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290040:0:5937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290048:0:5937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290055:0:5937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290061:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290068:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41524c00 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:3.0:1782727377.290072:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290080:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290092:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290110:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727377.290133:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e559500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c805432-a345-4b8b-859c-fa0b2938956c+17:3444:x1869324912478464:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727377.290139:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782727377.290162:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912478464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727377.290181:0:11871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727377.290189:0:11871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727377.290189:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912478336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727377.290336:0:11871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cef41524c00/0x9832bf6cd8a42edc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727377.290874:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1782727377.650181:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727378.461600:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727378.469489:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893563904 00000100:00100000:3.0:1782727378.469503:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893563904 00000100:00100000:3.0:1782727378.471111:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 222 00000100:00100000:3.0:1782727378.471131:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+9:5442:x1869324893563904:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727378.471155:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727378.471177:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42ee3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a1ed expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727378.471209:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42ee3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1ed expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727378.471220:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef41525800/0x9832bf6cd8a42ee3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1ed expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727378.471249:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41525800, rc 0) 00000100:00100000:3.0:1782727378.472511:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893563904:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 1381us (10909us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727378.472523:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 222 00000100:00100000:3.0:1782727378.476097:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727378.484138:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893564032 00000100:00100000:0.0:1782727378.484153:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893564032 00000100:00100000:0.0:1782727378.484269:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 223 00000100:00100000:0.0:1782727378.484280:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893564032:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727378.484438:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893564032:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 159us (8352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727378.484446:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 223 00000100:00100000:3.0:1782727378.495306:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727378.495672:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893564160 00000100:00100000:2.0:1782727378.495683:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893564160 00000100:00100000:2.0:1782727378.495745:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 224 00000100:00100000:2.0:1782727378.495755:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893564160:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727378.495903:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:5442:x1869324893564160:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 149us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727378.495912:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 224 00010000:00010000:3.0:1782727378.672029:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782727378.735010:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727378.735021:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8cef77814800 from 7 10000000:01000000:1.0:1782727378.735026:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727378.735078:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42eea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727378.735091:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42eea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727378.735103:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42eea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727378.735128:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912478592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727378.735213:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727378.735282:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727378.735352:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912478592 00000100:00100000:0.0:1782727378.735360:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912478592 00000100:00100000:0.0:1782727378.735419:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1782727378.735428:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+16:5949:x1869324912478592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727378.735443:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727378.735459:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef80273000/0x9832bf6cd8a42ef1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42eea expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727378.735486:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef80273000/0x9832bf6cd8a42ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42eea expref: 17 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727378.735498:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef80273000/0x9832bf6cd8a42ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42eea expref: 17 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727378.735507:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273000, rc 0) 00000100:00100000:0.0:1782727378.735565:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912478592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727378.735572:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1782727378.735865:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912478592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727378.735883:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42eea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ef1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727378.735892:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42eea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42ef1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727378.736009:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912478720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727378.736040:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727378.736065:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727378.736127:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912478720 00000100:00100000:0.0:1782727378.736132:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912478720 00000100:00100000:0.0:1782727378.736169:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782727378.736177:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912478720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727378.736313:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912478720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727378.736320:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1782727378.736486:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912478720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727378.736513:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912478848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727378.736566:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727378.736588:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef6db74480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727378.736698:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912478848 00000100:00100000:2.0:1782727378.736703:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912478848 00000100:00100000:2.0:1782727378.736738:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1782727378.736747:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912478848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727378.736838:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912478848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727378.736844:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1782727378.737809:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912478848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782727378.738905:0:11911:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782727378.739234:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782727378.739267:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727378.739280:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42eea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ef1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727378.739292:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef77da4e00/0x9832bf6cd8a42eea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42ef1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727378.739304:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782727378.739307:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8cef46963800 from 7 10000000:01000000:2.0:1782727378.739310:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727378.739352:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77f21000/0x9832bf6cd8a42ef8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727378.739361:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef77f21000/0x9832bf6cd8a42ef8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727378.739371:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef77f21000/0x9832bf6cd8a42ef8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727378.739413:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e558e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912478976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727378.739480:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727378.739520:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef786bb300 going to sleep for 11 seconds 00000100:00100000:1.0:1782727378.741732:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912478976 00000100:00100000:1.0:1782727378.741748:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912478976 00000100:00100000:1.0:1782727378.741813:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782727378.741823:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+17:5949:x1869324912478976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727378.741840:0:5945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727378.741858:0:5945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77da5a00/0x9832bf6cd8a42eff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42ef8 expref: -99 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727378.741888:0:5945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77da5a00/0x9832bf6cd8a42eff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42ef8 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727378.741900:0:5945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77da5a00/0x9832bf6cd8a42eff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42ef8 expref: 18 pid: 5945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727378.741910:0:5945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5a00, rc 0) 00000100:00100000:1.0:1782727378.742521:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912478976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 698us (3038us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727378.743785:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1782727378.743918:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e558e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912478976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727378.743971:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef77f21000/0x9832bf6cd8a42ef8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42eff expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727378.743992:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef77f21000/0x9832bf6cd8a42ef8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42eff expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727378.744089:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912479104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727378.744133:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727378.744171:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef58670240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727378.744322:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912479104 00000100:00100000:1.0:1782727378.744329:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912479104 00000100:00100000:1.0:1782727378.744363:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1782727378.744370:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912479104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727378.744500:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912479104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727378.744507:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1782727378.745314:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912479104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727378.745359:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912479232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727378.745410:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727378.745440:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef58670240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727378.745487:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912479232 00000100:00100000:1.0:1782727378.745493:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912479232 00000100:00100000:1.0:1782727378.747349:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782727378.747373:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912479232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727378.747546:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912479232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727378.747554:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1782727378.747860:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912479232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782727378.748588:0:11913:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782727378.748651:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782727378.748674:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782727378.748685:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef77f21000/0x9832bf6cd8a42ef8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42eff expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727378.748697:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef77f21000/0x9832bf6cd8a42ef8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42eff expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727378.748707:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782727378.748711:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8cef434e9800 from 7 10000000:01000000:0.0:1782727378.748713:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782727378.748746:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80273a00/0x9832bf6cd8a42f06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727378.748755:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff8cef80273a00/0x9832bf6cd8a42f06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727378.748778:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff8cef80273a00/0x9832bf6cd8a42f06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727378.748800:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912479360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727378.748847:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727378.752483:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef58670780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727378.752684:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912479360 00000100:00100000:2.0:1782727378.752693:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912479360 00000100:00100000:2.0:1782727378.753116:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782727378.753127:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+18:5949:x1869324912479360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727378.753146:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727378.753165:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cef77f20a00/0x9832bf6cd8a42f0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9832bf6cd8a42f06 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727378.753207:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cef77f20a00/0x9832bf6cd8a42f0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9832bf6cd8a42f06 expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727378.753219:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cef77f20a00/0x9832bf6cd8a42f0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9832bf6cd8a42f06 expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727378.753227:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f20a00, rc 0) 00000100:00100000:2.0:1782727378.753302:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912479360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (4453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727378.753309:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1782727378.753468:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912479360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727378.753486:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff8cef80273a00/0x9832bf6cd8a42f06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42f0d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727378.753495:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff8cef80273a00/0x9832bf6cd8a42f06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9832bf6cd8a42f0d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727378.753583:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912479488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727378.753617:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727378.753646:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef58670780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727378.753770:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912479488 00000100:00100000:2.0:1782727378.753776:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912479488 00000100:00100000:2.0:1782727378.753794:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1782727378.753799:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912479488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727378.753917:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912479488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727378.753961:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1782727378.756682:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912479488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727378.756747:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912479616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727378.756813:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727378.756856:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef58670780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727378.757080:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912479616 00000100:00100000:2.0:1782727378.757087:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912479616 00000100:00100000:2.0:1782727378.757129:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782727378.757138:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912479616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727378.757266:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:5949:x1869324912479616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727378.757273:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1782727378.758333:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c805432-a345-4b8b-859c-fa0b2938956c:5949:1869324912479616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782727378.759343:0:11915:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782727378.760640:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782727378.760671:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727378.760683:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff8cef80273a00/0x9832bf6cd8a42f06 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42f0d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727378.760696:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff8cef80273a00/0x9832bf6cd8a42f06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9832bf6cd8a42f0d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727379.695844:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727380.451153:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727380.451281:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727380.454356:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893564416 00000100:00100000:1.0:1782727380.454372:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893564416 00000100:00100000:1.0:1782727380.454450:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:1.0:1782727380.454461:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e55a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893564416:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727380.454555:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e55a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2338:x1869324893564416:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 95us (3273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727380.454563:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00080000:1.0:1782727380.454587:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727380.462747:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893564288 00000100:00100000:3.0:1782727380.462766:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893564288 00000100:00100000:3.0:1782727380.462942:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 234 00000100:00100000:3.0:1782727380.462953:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893564288:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727380.463082:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893564288:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 130us (11941us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727380.463090:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 234 00010000:00010000:2.0:1782727380.723163:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727380.979387:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912479744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727380.979461:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727380.980226:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912479744 00000100:00100000:1.0:1782727380.980243:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912479744 00000100:00100000:1.0:1782727380.980317:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782727380.980326:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912479744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727380.980359:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1782727380.980534:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727380.980710:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912479744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 384us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727380.980718:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1782727380.983084:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f51180 x1869324912479744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727380.983111:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912479744:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1782727381.370455:0:12069:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1782727381.490486:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912479872:0@lo:400:kworker.0 00000100:00100000:1.0:1782727381.490556:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727381.490604:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912480384:0@lo:400:kworker.0 00000100:00100000:1.0:1782727381.490633:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727381.490660:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727381.490665:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912480000:0@lo:400:kworker.0 00000100:00100000:1.0:1782727381.490690:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727381.490717:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912480128:0@lo:400:kworker.0 00000100:00100000:1.0:1782727381.490738:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727381.490755:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727381.490759:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912480256:0@lo:400:kworker.0 00000100:00100000:1.0:1782727381.490778:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727381.490806:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912479872 00000100:00100000:1.0:1782727381.490812:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912479872 00000100:00100000:1.0:1782727381.490855:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1782727381.490863:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3446:x1869324912479872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727381.490911:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3446:x1869324912479872:12345-0@lo:400:kworker.0 Request processed in 48us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727381.490918:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1782727381.490977:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912480384 00000100:00100000:1.0:1782727381.490981:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912480384 00000100:00100000:1.0:1782727381.491015:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727381.491021:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912480384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727381.491700:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912480384:12345-0@lo:400:kworker.0 Request processed in 675us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727381.491709:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727381.491732:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912480000 00000100:00100000:1.0:1782727381.491737:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912480000 00000100:00100000:1.0:1782727381.491811:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912480128 00000100:00100000:1.0:1782727381.491815:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912480128 00000100:00100000:0.0:1782727381.491892:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912480256 00000100:00100000:0.0:1782727381.491896:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912480256 00000100:00100000:0.0:1782727381.491917:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782727381.491923:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912480000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727381.491988:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912480000:12345-0@lo:400:kworker.0 Request processed in 65us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727381.491994:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782727381.492007:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782727381.492013:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912480128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727381.492234:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912480128:12345-0@lo:400:kworker.0 Request processed in 35us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727381.492243:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782727381.492257:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782727381.492264:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912480256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727381.492295:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912480256:12345-0@lo:400:kworker.0 Request processed in 31us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727381.492301:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1782727381.492313:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727381.492318:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727381.492359:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912480000:0@lo:400:kworker.0 00000100:00100000:2.0:1782727381.492364:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912480256:0@lo:400:kworker.0 00000100:00100000:1.0:1782727381.492377:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c805432-a345-4b8b-859c-fa0b2938956c:3446:1869324912479872:0@lo:400:kworker.0 00000100:00100000:2.0:1782727381.492387:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912480128:0@lo:400:kworker.0 00010000:00080000:1.0:1782727381.492397:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4d9880 x1869324912480384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727381.492410:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912480384:0@lo:400:kworker.0 00010000:00010000:3.0:1782727381.743121:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727382.001782:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912480512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727382.001867:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727382.002030:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912480512 00000100:00100000:2.0:1782727382.002038:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912480512 00000100:00100000:2.0:1782727382.002100:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782727382.002110:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70380700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912480512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727382.002138:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727382.008174:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70380700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912480512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6050us (6292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727382.008190:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1782727382.017836:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e1db480 x1869324912480512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727382.017866:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912480512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782727382.768978:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727383.791300:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727384.815129:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727385.567253:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727385.567291:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893564544 00000100:00100000:2.0:1782727385.567300:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727385.567303:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893564544 00000100:00100000:3.0:1782727385.567367:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 236 00000100:00100000:3.0:1782727385.567380:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893564544:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727385.567413:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893564672 00000100:00100000:1.0:1782727385.567419:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893564672 00000100:00100000:3.0:1782727385.567465:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893564544:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727385.567475:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 236 00000100:00100000:1.0:1782727385.567479:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 97 00000100:00100000:1.0:1782727385.567497:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893564672:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727385.567534:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893564672:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 40us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727385.567541:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 97 00000100:00080000:2.0:1782727385.567786:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727385.839752:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727386.095492:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912480640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727386.095579:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727386.095829:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912480640 00000100:00100000:1.0:1782727386.095837:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912480640 00000100:00100000:1.0:1782727386.095906:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782727386.095916:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e55b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912480640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727386.095980:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:0.0:1782727386.097176:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727386.100234:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e55b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912480640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4307us (4643us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727386.100250:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1782727386.100712:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f51880 x1869324912480640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727386.100746:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912480640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727386.611873:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912480896:0@lo:400:kworker.0 00000100:00100000:0.0:1782727386.612011:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727386.612017:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912481152:0@lo:400:kworker.0 00000100:00100000:2.0:1782727386.612046:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727386.612062:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727386.612069:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912481024:0@lo:400:kworker.0 00000100:00100000:1.0:1782727386.612165:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912480768:0@lo:400:kworker.0 00000100:00100000:0.0:1782727386.614306:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912480896 00000100:00100000:0.0:1782727386.614322:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912480896 00000100:00100000:0.0:1782727386.614392:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912481152 00000100:00100000:0.0:1782727386.614396:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912481152 00000100:00100000:0.0:1782727386.614429:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782727386.614439:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912480896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727386.624517:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727386.624588:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912481280:0@lo:400:kworker.0 00000100:00100000:1.0:1782727386.624633:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727386.624709:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782727386.624726:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912481152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727386.624787:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912481152:12345-0@lo:400:kworker.0 Request processed in 68us (12740us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727386.624795:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782727386.624828:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912480768 00000100:00100000:1.0:1782727386.624835:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912480768 00000100:00100000:1.0:1782727386.624878:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1782727386.624885:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912480768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727386.624956:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912480768:12345-0@lo:400:kworker.0 Request processed in 70us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727386.625044:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1782727386.625051:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912481280 00000100:00100000:0.0:1782727386.625057:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912481280 00000100:00100000:0.0:1782727386.625116:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782727386.625125:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912481280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727386.625149:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912480768:0@lo:400:kworker.0 00000100:00100000:0.0:1782727386.625172:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912481280:12345-0@lo:400:kworker.0 Request processed in 48us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727386.625234:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912481152:0@lo:400:kworker.0 00010000:00080000:1.0:1782727386.625315:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e4d5180 x1869324912481280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727386.625327:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912481280:0@lo:400:kworker.0 00000100:00080000:2.0:1782727386.626010:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727386.626016:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727386.626056:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782727386.626091:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727386.626152:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912481024 00000100:00100000:2.0:1782727386.626158:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912481024 00000100:00100000:0.0:1782727386.626193:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912480896:12345-0@lo:400:kworker.0 Request processed in 11754us (14181us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727386.626201:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782727386.626209:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912481024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727386.626261:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912481024:12345-0@lo:400:kworker.0 Request processed in 39us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727386.626367:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782727386.626401:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912481024:0@lo:400:kworker.0 00000100:00100000:0.0:1782727386.626414:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912480896:0@lo:400:kworker.0 00000100:00080000:3.0:1782727386.627036:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727386.628308:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:0.0:1782727386.868706:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727386.925256:0:12217:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 06:03:04 (1782727384) === 00000100:00100000:0.0:1782727387.022869:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727387.022981:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893564800 00000100:00100000:1.0:1782727387.022992:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893564800 00000100:00100000:1.0:1782727387.023059:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:1.0:1782727387.023070:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:7461:x1869324893564800:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1782727387.023090:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1782727387.024225:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727387.029050:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a42f14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a1f4 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.029190:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.029208:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.029244:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030209:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030227:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030239:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030389:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030397:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030404:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030411:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727387.030416:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030425:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030439:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef700a7700) 00010000:00010000:2.0:1782727387.030442:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727387.030447:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030463:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030481:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030487:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030493:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030498:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727387.030501:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030506:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030512:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff8cef78c3af00) 00010000:00010000:2.0:1782727387.030514:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727387.030516:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030522:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030575:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a42f14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1f4 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030596:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef700a7700) 00010000:00010000:2.0:1782727387.030599:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782727387.030603:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a42f14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1f4 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.030613:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f20000, rc 0) 00000100:00100000:2.0:1782727387.030874:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:7461:x1869324893564800:12345-192.168.204.23@tcp:101:bash.0 Request processed in 7803us (8010us total) trans 0 rc 301/301 00000100:00100000:2.0:1782727387.030886:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:1.0:1782727387.047377:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.047442:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893564928 00000100:00100000:0.0:1782727387.047453:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893564928 00000100:00100000:0.0:1782727387.047532:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1782727387.047543:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:7461:x1869324893564928:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1782727387.047564:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727387.047598:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a1fb expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.047681:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.047697:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.047711:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.047781:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.047790:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.047797:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048108:0:9207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048118:0:9207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048125:0:9207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048132:0:9207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727387.048137:0:9207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048155:0:9207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048169:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef700a7700) 00010000:00010000:0.0:1782727387.048172:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727387.048176:0:9207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048181:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048193:0:9207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048198:0:9207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048204:0:9207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048208:0:9207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80272c00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727387.048211:0:9207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048216:0:9207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048222:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff8cef77d9b000) 00010000:00010000:0.0:1782727387.048224:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727387.048227:0:9207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048241:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048275:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1fb expref: 7 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048286:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef700a7700) 00010000:00010000:0.0:1782727387.048288:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782727387.048292:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1fb expref: 7 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.048301:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273e00, rc 0) 00000100:00100000:0.0:1782727387.048363:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:7461:x1869324893564928:12345-192.168.204.23@tcp:101:bash.0 Request processed in 821us (1002us total) trans 0 rc 301/301 00000100:00100000:0.0:1782727387.048370:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1782727387.052533:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727387.052731:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893565056 00000100:00100000:3.0:1782727387.052742:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893565056 00000100:00100000:3.0:1782727387.052802:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:3.0:1782727387.052812:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:7461:x1869324893565056:12345-192.168.204.23@tcp:37:bash.0 00000100:00100000:3.0:1782727387.066666:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:7461:x1869324893565056:12345-192.168.204.23@tcp:37:bash.0 Request processed in 13844us (14133us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727387.066683:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:2.0:1782727387.083873:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727387.083921:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893565184 00000100:00100000:2.0:1782727387.083970:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893565184 00000100:00100000:2.0:1782727387.084029:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:2.0:1782727387.084042:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10348:x1869324893565184:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:2.0:1782727387.084073:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727387.084102:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a202 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.084169:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a42f45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.084185:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a42f45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.084197:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a42f45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086152:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086181:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086196:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086264:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a42f45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086273:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a42f45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086281:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a42f45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086289:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f20c00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727387.086294:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a42f45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086304:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a42f45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086320:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef700a7700) 00010000:00010000:2.0:1782727387.086325:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727387.086330:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a42f45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086406:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a42f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086433:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086437:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086441:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086444:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727387.086446:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086449:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086454:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff8cef78c3af00) 00010000:00010000:2.0:1782727387.086456:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727387.086457:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086460:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a42f4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086509:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a202 expref: 7 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086517:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef700a7700) 00010000:00010000:2.0:1782727387.086519:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727387.086529:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a42f3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a202 expref: 7 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.086537:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f21600, rc 0) 00000100:00100000:2.0:1782727387.086633:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10348:x1869324893565184:12345-192.168.204.23@tcp:101:rm.0 Request processed in 2593us (2768us total) trans 0 rc 301/301 00000100:00100000:2.0:1782727387.086643:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:2.0:1782727387.119335:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912481408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727387.119408:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727387.119462:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912481408 00000100:00100000:0.0:1782727387.119471:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912481408 00000100:00100000:0.0:1782727387.119527:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782727387.119537:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912481408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727387.119570:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727387.119638:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912481408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727387.119646:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1782727387.121225:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e52d180 x1869324912481408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727387.121250:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912481408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727387.146502:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727387.146562:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.146625:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893565312 00000100:00100000:0.0:1782727387.146639:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893565312 00000100:00100000:0.0:1782727387.146728:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:0.0:1782727387.146760:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893565312:12345-192.168.204.23@tcp:41:mkdir.0 00000004:00000024:0.0:1782727387.146838:0:9207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1782727387.146845:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893565440 00000100:00100000:1.0:1782727387.146852:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893565440 00000100:00100000:1.0:1782727387.146902:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1782727387.146911:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10351:x1869324893565440:12345-192.168.204.23@tcp:700:mkdir.0 00000100:00100000:0.0:1782727387.147009:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2337:x1869324893565312:12345-192.168.204.23@tcp:41:mkdir.0 Request processed in 252us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727387.147018:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:1.0:1782727387.147074:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10351:x1869324893565440:12345-192.168.204.23@tcp:700:mkdir.0 Request processed in 164us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727387.147083:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:2.0:1782727387.149952:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727387.150551:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893565696 00000100:00100000:3.0:1782727387.150564:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893565696 00000100:00100000:3.0:1782727387.150628:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:3.0:1782727387.150638:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10351:x1869324893565696:12345-192.168.204.23@tcp:36:mkdir.0 00010000:00010000:3.0:1782727387.150694:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727387.150721:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a42e26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a1d1 expref: 6 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.150743:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef700a7700) 00010000:00010000:3.0:1782727387.150756:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727387.150814:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a42f53 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.150828:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a42f53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.150837:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a42f53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.150913:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.150921:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.152503:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727387.154294:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782727387.154314:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a42f53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.154323:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a42f53 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.154330:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a42f53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.154336:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727387.154341:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a42f53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.154348:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a42f53 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.154382:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef700a7800) 00010000:00010000:2.0:1782727387.154385:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727387.154390:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a42f53 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.154398:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a42f53 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727387.154424:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3f3ca04 reply state 00000000be450f38 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727387.154434:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727387.154665:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10351:x1869324893565696:12345-192.168.204.23@tcp:36:mkdir.0 Request processed in 4025us (4746us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782727387.154674:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00010000:00010000:0.0:1782727387.156197:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.156219:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.156226:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.156231:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41524c00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727387.156234:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.156240:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.156253:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cef700a7600) 00010000:00010000:0.0:1782727387.156256:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727387.156259:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.156264:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a42f5a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727387.166845:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.167040:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893565824 00000100:00100000:0.0:1782727387.167065:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893565824 00000100:00100000:0.0:1782727387.167133:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:0.0:1782727387.167144:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e55b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10352:x1869324893565824:12345-192.168.204.23@tcp:101:chmod.0 00010000:00010000:0.0:1782727387.167176:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727387.167199:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a209 expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.167279:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.167293:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.167304:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727387.167352:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727387.167356:0:9207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727387.167389:0:9207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.167414:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a209 expref: 8 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.167432:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a209 expref: 7 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.167441:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9b000) 00010000:00010000:0.0:1782727387.167444:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727387.167448:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80272c00, rc 0) 00000100:00100000:0.0:1782727387.167518:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e55b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10352:x1869324893565824:12345-192.168.204.23@tcp:101:chmod.0 Request processed in 375us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727387.167525:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:2.0:1782727387.170608:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.171135:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893566080 00000100:00100000:0.0:1782727387.171145:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893566080 00000100:00100000:0.0:1782727387.171221:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:0.0:1782727387.171231:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10352:x1869324893566080:12345-192.168.204.23@tcp:36:chmod.0 00010000:00010000:0.0:1782727387.171693:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727387.171721:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a209 expref: 7 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.171739:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9b000) 00010000:00010000:0.0:1782727387.171749:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727387.171773:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.171785:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.171792:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727387.172016:0:5951:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a46b87d3 reply state 00000000e3636825 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727387.172026:0:5951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782727387.172033:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782727387.172912:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:10352:x1869324893566080:12345-192.168.204.23@tcp:36:chmod.0 Request processed in 1676us (2307us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782727387.172922:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00010000:00010000:3.0:1782727387.180904:0:3431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.180921:0:3431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.181016:0:3431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.181024:0:3431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727387.181028:0:3431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.181036:0:3431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.181052:0:3431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9bf00) 00010000:00010000:3.0:1782727387.181056:0:3431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782727387.181061:0:3431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.181067:0:3431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42f6f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727387.204173:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727387.204285:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893566208 00000100:00100000:1.0:1782727387.204295:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893566208 00000100:00100000:1.0:1782727387.204373:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:1.0:1782727387.204383:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10353:x1869324893566208:12345-192.168.204.23@tcp:101:chown.0 00010000:00010000:1.0:1782727387.204424:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727387.204450:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a42f76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a210 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.204515:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a42f7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.204529:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a42f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.204543:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a42f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727387.204592:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727387.204596:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727387.204631:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a42f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.204657:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a42f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a210 expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.204677:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a42f7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a210 expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.204686:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8200) 00010000:00010000:1.0:1782727387.204689:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727387.204692:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5600, rc 0) 00000100:00100000:1.0:1782727387.204862:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:10353:x1869324893566208:12345-192.168.204.23@tcp:101:chown.0 Request processed in 480us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727387.204870:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:2.0:1782727387.208983:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.209119:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893566336 00000100:00100000:0.0:1782727387.209129:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893566336 00000100:00100000:0.0:1782727387.209185:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:0.0:1782727387.209206:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:10353:x1869324893566336:12345-192.168.204.23@tcp:101:chown.0 00010000:00010000:0.0:1782727387.209226:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727387.209245:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a217 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209309:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209323:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209334:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209347:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42f92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209354:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209370:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209453:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a42f99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209462:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a42f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209489:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a42f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727387.209536:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727387.209540:0:5954:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727387.209566:0:5954:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a42f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209579:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209586:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209593:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209599:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273e00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727387.209603:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209610:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209622:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8200) 00010000:00010000:0.0:1782727387.209625:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727387.209630:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209635:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a42f8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209657:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209663:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42f92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209668:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209674:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727387.209676:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209682:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42f92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209689:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cef77d9b000) 00010000:00010000:0.0:1782727387.209691:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727387.209694:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42f92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209699:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42f92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209733:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a42f84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a217 expref: 10 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209744:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a42f99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a217 expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.209762:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef77d9ba00) 00010000:00010000:0.0:1782727387.209763:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727387.209766:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273600, rc 0) 00000100:00100000:0.0:1782727387.210071:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:10353:x1869324893566336:12345-192.168.204.23@tcp:101:chown.0 Request processed in 865us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727387.210080:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:2.0:1782727387.214821:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.215201:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893566592 00000100:00100000:0.0:1782727387.215212:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893566592 00000100:00100000:0.0:1782727387.215270:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:0.0:1782727387.215280:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e55b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:10353:x1869324893566592:12345-192.168.204.23@tcp:36:chown.0 00010000:00010000:0.0:1782727387.215494:0:9207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727387.215521:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a42f99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a217 expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.215547:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef77d9ba00) 00010000:00010000:0.0:1782727387.215560:0:9207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727387.215586:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.215598:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.215608:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782727387.221234:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1782727387.222000:0:9207:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f292c2c reply state 00000000d6795a42 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727387.222047:0:9207:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782727387.222442:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1782727387.222553:0:9207:0:(ldlm_lib.c:3443:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782727387.222579:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e55b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10353:x1869324893566592:12345-192.168.204.23@tcp:36:chown.0 Request processed in 7291us (7760us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782727387.222589:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00010000:00010000:1.0:1782727387.222714:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.222722:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.222729:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.222735:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727387.222740:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.222747:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.222763:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef77d9b800) 00010000:00010000:1.0:1782727387.222765:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782727387.222771:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.222777:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a42fa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727387.238177:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727387.238805:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893566720 00000100:00100000:1.0:1782727387.238817:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893566720 00000100:00100000:1.0:1782727387.239041:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:1.0:1782727387.239061:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10354:x1869324893566720:12345-192.168.204.23@tcp:101:touch.500 00010000:00010000:1.0:1782727387.239088:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727387.239119:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a42fa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a21e expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782727387.241603:0:5951:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2030us 00010000:00010000:1.0:1782727387.264210:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a42fae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.264232:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a42fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.264246:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a42fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.264264:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a42fb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.264272:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a42fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.264279:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a42fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265482:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a42fbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265495:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a42fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265504:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a42fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727387.265539:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727387.265543:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727387.265578:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a42fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265607:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a42fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265613:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a42fae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265620:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a42fae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265626:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da5400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727387.265630:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a42fae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265637:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a42fae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265649:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8200) 00010000:00010000:1.0:1782727387.265652:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727387.265656:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a42fae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265662:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a42fae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265675:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a42fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265681:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a42fb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265686:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a42fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265698:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da5200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727387.265701:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a42fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265707:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a42fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265715:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cef51af8d00) 00010000:00010000:1.0:1782727387.265717:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727387.265720:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a42fb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.265725:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a42fb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.267456:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a42fa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a21e expref: 8 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.267477:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a42fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a21e expref: 7 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.267485:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef51af8300) 00010000:00010000:1.0:1782727387.267488:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782727387.267490:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5e00, rc 0) 00000100:00100000:1.0:1782727387.267575:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10354:x1869324893566720:12345-192.168.204.23@tcp:101:touch.500 Request processed in 28524us (29408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727387.267584:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:1.0:1782727387.270920:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727387.271102:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893566976 00000100:00100000:2.0:1782727387.271114:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893566976 00000100:00100000:2.0:1782727387.271171:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:2.0:1782727387.271182:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10354:x1869324893566976:12345-192.168.204.23@tcp:101:touch.500 00010000:00010000:2.0:1782727387.271204:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727387.271224:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21a00/0x9832bf6cd8a42fc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a225 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.271367:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a42fca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.271387:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a42fca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.271398:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a42fca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.272014:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.272039:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.272052:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782727387.275686:0:5953:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1782727387.277796:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a42fd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.277827:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a42fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.277851:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a42fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.277895:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a42fca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.277919:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a42fca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.277944:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a42fca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.277951:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21e00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727387.277956:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a42fca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.277964:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a42fca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.277977:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef51af8300) 00010000:00010000:2.0:1782727387.277980:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727387.277986:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a42fca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.277992:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a42fca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727387.278010:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000effb8000 reply state 00000000a21309ed transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727387.278021:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782727387.278067:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21a00/0x9832bf6cd8a42fc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a225 expref: 10 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.278084:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a42fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a225 expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.278116:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cef78c3a800) 00010000:00010000:2.0:1782727387.278120:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727387.278124:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f21c00, rc 0) 00000100:00100000:2.0:1782727387.278230:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:10354:x1869324893566976:12345-192.168.204.23@tcp:101:touch.500 Request processed in 7049us (7319us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1782727387.278240:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00010000:00010000:1.0:1782727387.281325:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.281344:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.281353:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.281371:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727387.281377:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.281385:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.281404:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x994acc37 (ffff8cef78c3af00) 00010000:00010000:1.0:1782727387.281408:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727387.281413:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.281419:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a42fd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727387.284794:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727387.285012:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893567232 00000100:00100000:2.0:1782727387.285028:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893567232 00000100:00100000:2.0:1782727387.285107:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:2.0:1782727387.285121:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:10354:x1869324893567232:12345-192.168.204.23@tcp:36:touch.500 00010000:00010000:2.0:1782727387.285208:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727387.285243:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a42fd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a225 expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.285266:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cef78c3a800) 00010000:00010000:2.0:1782727387.285278:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727387.285343:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.285356:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.285363:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727387.286321:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1829c3f reply state 000000003bcd025c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727387.286356:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727387.286781:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:10354:x1869324893567232:12345-192.168.204.23@tcp:36:touch.500 Request processed in 1660us (1993us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782727387.286793:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00010000:00010000:3.0:1782727387.290884:0:3431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.290910:0:3431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.290920:0:3431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.290972:0:3431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f20800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727387.290979:0:3431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.290989:0:3431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.291013:0:3431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cef78c3a700) 00010000:00010000:3.0:1782727387.291017:0:3431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727387.291024:0:3431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.291031:0:3431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a42fe6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727387.291151:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.291241:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893567360 00000100:00100000:0.0:1782727387.291255:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893567360 00000100:00100000:0.0:1782727387.291331:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:0.0:1782727387.291344:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:10354:x1869324893567360:12345-192.168.204.23@tcp:101:touch.500 00010000:00010000:0.0:1782727387.291377:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727387.291399:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42fed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a22c expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.291470:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42fed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a22c expref: 10 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.291486:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42fed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a22c expref: 10 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.291597:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cef77d9ba00) 00010000:00010000:0.0:1782727387.291601:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782727387.291603:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273400, rc 0) 00000100:00100000:0.0:1782727387.291693:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:10354:x1869324893567360:12345-192.168.204.23@tcp:101:touch.500 Request processed in 351us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727387.291719:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:0.0:1782727387.295577:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727387.295822:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893567488 00000100:00100000:1.0:1782727387.295836:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893567488 00000100:00100000:1.0:1782727387.295992:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1782727387.296004:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2335:x1869324893567488:12345-192.168.204.23@tcp:8:touch.500 00010000:00080000:1.0:1782727387.296057:0:6940:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from 4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:1.0:1782727387.296149:0:6940:0:(genops.c:1406:class_connect()) connect: client 4c9ff188-fb9c-4b39-a5ed-2408b1373248, cookie 0x9832bf6cd8a42ff4 00002000:00100000:1.0:1782727387.296167:0:6940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c9ff188-fb9c-4b39-a5ed-2408b1373248/ffff8cef77f2e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782727387.296180:0:6940:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782727387.296288:0:6940:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782727387.296328:0:6940:0:(import.c:65:import_set_state_nolock()) ffff8cef77f2c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727387.296424:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2335:x1869324893567488:12345-192.168.204.23@tcp:8:touch.500 Request processed in 420us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727387.296433:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:2.0:1782727387.299796:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.300185:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893567616 00000100:00100000:0.0:1782727387.300198:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893567616 00000100:00100000:0.0:1782727387.300576:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:0.0:1782727387.300590:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e55bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:0:x1869324893567616:12345-192.168.204.23@tcp:2:touch.500 00000100:00080000:3.0:1782727387.300980:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1782727387.309211:0:8023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1782727387.309231:0:8023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c9ff188-fb9c-4b39-a5ed-2408b1373248 00000100:00100000:2.0:1782727387.309545:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e55bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:0:x1869324893567616:12345-192.168.204.23@tcp:2:touch.500 Request processed in 8949us (9755us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782727387.309562:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:2.0:1782727387.314870:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727387.315044:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893567872 00000100:00100000:1.0:1782727387.315058:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893567872 00000100:00100000:1.0:1782727387.315165:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:1.0:1782727387.315178:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:10354:x1869324893567872:12345-192.168.204.23@tcp:35:touch.500 00000100:00100000:1.0:1782727387.315644:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+11:10354:x1869324893567872:12345-192.168.204.23@tcp:35:touch.500 Request processed in 465us (788us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1782727387.315654:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:0.0:1782727387.339869:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727387.345113:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893568000 00000100:00100000:1.0:1782727387.345135:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893568000 00000100:00100000:1.0:1782727387.345232:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:1.0:1782727387.345245:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+11:10355:x1869324893568000:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:1.0:1782727387.345279:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727387.345305:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a42ffb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a233 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.345396:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43002 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.345447:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.345911:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727387.346204:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727387.346209:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727387.346259:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.346299:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a42ffb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a233 expref: 13 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.346322:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a233 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.346333:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef51af8300) 00010000:00010000:1.0:1782727387.346337:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727387.346341:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5200, rc 0) 00000100:00100000:1.0:1782727387.346447:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+12:10355:x1869324893568000:12345-192.168.204.23@tcp:101:rm.0 Request processed in 1203us (6591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727387.347061:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:2.0:1782727387.355734:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727387.359693:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893568256 00000100:00100000:1.0:1782727387.359718:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893568256 00000100:00100000:0.0:1782727387.360169:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:0.0:1782727387.360186:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+12:10355:x1869324893568256:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:0.0:1782727387.360207:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727387.360244:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a23a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727387.360451:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782727387.360613:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43009 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a23a expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.360628:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8200) 00010000:00010000:0.0:1782727387.360631:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782727387.360637:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a23a expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.360651:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273200, rc 0) 00000100:00100000:0.0:1782727387.360727:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+13:10355:x1869324893568256:12345-192.168.204.23@tcp:101:rm.0 Request processed in 544us (5009us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1782727387.360741:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:2.0:1782727387.366072:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727387.366497:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893568384 00000100:00100000:3.0:1782727387.366508:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893568384 00000100:00100000:3.0:1782727387.366575:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:3.0:1782727387.366585:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+13:10355:x1869324893568384:12345-192.168.204.23@tcp:37:rm.0 00000100:00100000:3.0:1782727387.374129:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+13:10355:x1869324893568384:12345-192.168.204.23@tcp:37:rm.0 Request processed in 7535us (8058us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727387.374144:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:2.0:1782727387.380776:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727387.380906:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893568640 00000100:00100000:1.0:1782727387.380918:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893568640 00000100:00100000:1.0:1782727387.381038:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:1.0:1782727387.381050:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef80095850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+13:10355:x1869324893568640:12345-192.168.204.23@tcp:35:rm.0 00000100:00100000:0.0:1782727387.381503:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef80095850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+14:10355:x1869324893568640:12345-192.168.204.23@tcp:35:rm.0 Request processed in 453us (734us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782727387.381514:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:2.0:1782727387.384680:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727387.384769:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893568896 00000100:00100000:1.0:1782727387.384778:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893568896 00000100:00100000:1.0:1782727387.384853:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:1.0:1782727387.384866:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+14:10355:x1869324893568896:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:1.0:1782727387.384896:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727387.384920:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a241 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.385158:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4301e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.385182:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4301e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.385193:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4301e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727387.385204:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1782727387.385370:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a241 expref: 17 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.385391:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4301e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a241 expref: 16 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.385401:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef51af8300) 00010000:00010000:1.0:1782727387.385403:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782727387.385407:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da4a00, rc 0) 00000100:00100000:1.0:1782727387.385477:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:10355:x1869324893568896:12345-192.168.204.23@tcp:101:rm.0 Request processed in 613us (806us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1782727387.385495:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:2.0:1782727387.393727:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.393981:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893569024 00000100:00100000:0.0:1782727387.393991:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893569024 00000100:00100000:0.0:1782727387.394059:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:0.0:1782727387.394071:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:10355:x1869324893569024:12345-192.168.204.23@tcp:41:rm.0 00000004:00000024:0.0:1782727387.394138:0:9207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847337984 avail 7384293376 00000100:00100000:0.0:1782727387.394211:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:10355:x1869324893569024:12345-192.168.204.23@tcp:41:rm.0 Request processed in 142us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727387.394219:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:2.0:1782727387.396715:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.396858:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893569152 00000100:00100000:0.0:1782727387.396869:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893569152 00000100:00100000:0.0:1782727387.397020:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:0.0:1782727387.397037:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:10355:x1869324893569152:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:0.0:1782727387.397059:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727387.397084:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a4302c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a248 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397351:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a43033 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397439:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a43033 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397452:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a43033 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397477:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4303a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x994acc37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397485:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4303a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397492:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4303a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397647:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a43041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397656:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a43041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397663:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a43041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727387.397702:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782727387.397706:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727387.397726:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a43041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397738:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a43041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397746:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a43033 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397752:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a43033 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397768:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a43033 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397774:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80272600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727387.397778:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a43033 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397787:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a43033 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397799:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef51af8300) 00010000:00010000:0.0:1782727387.397801:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727387.397806:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a43033 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397811:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a43033 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397825:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4303a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397830:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4303a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397835:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4303a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397839:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80272a00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727387.397842:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4303a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397857:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4303a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397865:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x994acc37 (ffff8cef77d9b000) 00010000:00010000:0.0:1782727387.397866:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727387.397869:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4303a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397874:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4303a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397908:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a4302c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a248 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.397921:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a43041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a248 expref: 17 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.398102:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cef77d9ba00) 00010000:00010000:0.0:1782727387.398104:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727387.398107:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273e00, rc 0) 00000100:00100000:0.0:1782727387.398192:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+17:10355:x1869324893569152:12345-192.168.204.23@tcp:101:rm.0 Request processed in 1161us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727387.398201:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:2.0:1782727387.402711:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727387.404405:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893569408 00000100:00100000:0.0:1782727387.404420:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893569408 00000100:00100000:0.0:1782727387.404713:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:0.0:1782727387.404724:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+17:10355:x1869324893569408:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:0.0:1782727387.404797:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782727387.404823:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a43041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a248 expref: 17 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.404848:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a42fed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a22c expref: 16 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.404859:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cef77d9ba00) 00010000:00010000:0.0:1782727387.404876:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a233 expref: 15 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.404886:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef51af8300) 00010000:00010000:0.0:1782727387.404890:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727387.404907:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a43048 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.404920:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a43048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.404949:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a43048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.404962:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.404969:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.404975:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.405066:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a43056 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.405073:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a43056 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.405080:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a43056 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782727387.405913:0:5953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1782727387.405985:0:5953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291581997131ns, next at 292581994919ns, rc = 0 00010000:00010000:0.0:1782727387.406044:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.406753:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.406765:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.406775:0:5953:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.406781:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.406788:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407019:0:5953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727387.407044:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a43056 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407064:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a43056 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407071:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a43056 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407076:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727387.407081:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a43056 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407099:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a43056 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407112:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cef77d9b300) 00010000:00010000:0.0:1782727387.407114:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782727387.407119:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a43056 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407125:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a43056 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.407142:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727387.407145:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a43048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407152:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a43048 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407159:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a43048 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.407160:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407172:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80272c00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727387.407175:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82045e00 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:2.0:1782727387.407180:0:6954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407183:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a43048 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.407194:0:6954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727387.407196:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a43048 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.407215:0:6954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cef77d9b300) 00010000:00010000:0.0:1782727387.407216:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef51af8300) 00010000:00010000:0.0:1782727387.407219:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727387.407222:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a43048 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.407228:0:6954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782727387.407233:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.407250:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045e00/0x9832bf6cd8a4305d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.407269:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727387.407271:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727387.407272:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727387.407398:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a43048 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727387.407410:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2e67a80 reply state 00000000c047b44c transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727387.407420:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727387.407582:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:10355:x1869324893569408:12345-192.168.204.23@tcp:36:rm.0 Request processed in 2856us (4877us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1782727387.407593:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00010000:00010000:1.0:1782727387.415829:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.415846:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.415855:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.415860:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727387.415865:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.415873:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.415890:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x994acc37 (ffff8cef77d9b700) 00010000:00010000:1.0:1782727387.415893:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727387.415897:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.415903:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a4304f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x994acc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727387.420569:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727387.420671:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893569664 00000100:00100000:3.0:1782727387.420684:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893569664 00000100:00100000:3.0:1782727387.420815:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:3.0:1782727387.420831:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+15:10355:x1869324893569664:12345-192.168.204.23@tcp:35:rm.0 00000100:00100000:3.0:1782727387.422417:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:10355:x1869324893569664:12345-192.168.204.23@tcp:35:rm.0 Request processed in 1132us (1406us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782727387.422435:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:2.0:1782727387.428666:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727387.428997:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893569920 00000100:00100000:1.0:1782727387.429012:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893569920 00000100:00100000:1.0:1782727387.429170:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:1.0:1782727387.429182:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:10355:x1869324893569920:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:1.0:1782727387.429245:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782727387.429287:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4301e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a241 expref: 16 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.429314:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a42fbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a21e expref: 15 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.429326:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef51af8300) 00010000:00010000:1.0:1782727387.429339:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a42f7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a210 expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.429348:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8200) 00010000:00010000:1.0:1782727387.429354:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727387.429379:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43064 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.429391:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43064 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.429401:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43064 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.430729:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.430747:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.430757:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.431803:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43072 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.431826:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43072 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.431836:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43072 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727387.433321:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1782727387.433342:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43072 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433350:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43072 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433359:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43072 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433365:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da5200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727387.433369:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43072 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433377:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43072 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433391:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cef51af8d00) 00010000:00010000:1.0:1782727387.433394:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782727387.433398:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43072 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433405:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5200/0x9832bf6cd8a43072 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433431:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43064 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433449:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43064 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433455:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43064 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433461:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da4600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727387.433464:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43064 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433470:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43064 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433478:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8000) 00010000:00010000:1.0:1782727387.433480:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727387.433483:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43064 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727387.433488:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4600/0x9832bf6cd8a43064 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727387.433503:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5e98c4d reply state 00000000a205cef4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727387.433512:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782727387.433606:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+15:10355:x1869324893569920:12345-192.168.204.23@tcp:36:rm.0 Request processed in 4422us (4951us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1782727387.433616:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00010000:00010000:3.0:1782727387.437582:0:3431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.437606:0:3431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.437625:0:3431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.437633:0:3431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da5c00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727387.437639:0:3431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.437649:0:3431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.437672:0:3431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cef51af8b00) 00010000:00010000:3.0:1782727387.437676:0:3431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727387.437701:0:3431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727387.437709:0:3431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5c00/0x9832bf6cd8a4306b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727387.887538:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727388.914227:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727389.937682:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727390.683251:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727390.683303:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727390.683344:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727390.683344:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893570048 00000100:00100000:2.0:1782727390.683361:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893570048 00000100:00100000:1.0:1782727390.683393:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893570304 00000100:00100000:1.0:1782727390.683398:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893570304 00000100:00100000:2.0:1782727390.683439:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 238 00000100:00100000:2.0:1782727390.683451:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893570048:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727390.683462:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:1.0:1782727390.683469:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2337:x1869324893570304:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727390.683561:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893570176 00000100:00100000:0.0:1782727390.683566:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893570176 00000100:00080000:3.0:1782727390.683600:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727390.683607:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 101 00000100:00080000:3.0:1782727390.683609:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727390.683616:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+14:2337:x1869324893570176:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727390.683711:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2337:x1869324893570304:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 242us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727390.683719:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:2.0:1782727390.685749:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893570048:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 2286us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727390.685769:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 238 00000100:00100000:0.0:1782727390.686209:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+14:2337:x1869324893570176:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 2589us (2859us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727390.686221:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 101 00010000:00010000:2.0:1782727390.959600:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727391.217988:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912481536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727391.218108:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727391.219196:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912481536 00000100:00100000:0.0:1782727391.219214:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912481536 00000100:00100000:0.0:1782727391.219348:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782727391.219361:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912481536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727391.219408:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1782727391.219583:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727391.219733:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912481536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 374us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727391.219742:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1782727391.219913:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef77f53480 x1869324912481536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727391.219973:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912481536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727391.727720:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912481920:0@lo:400:kworker.0 00000100:00100000:3.0:1782727391.727827:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727391.727987:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912481792:0@lo:400:kworker.0 00000100:00100000:1.0:1782727391.728037:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727391.728082:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727391.728088:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912481664:0@lo:400:kworker.0 00000100:00100000:1.0:1782727391.728123:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727391.728196:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912481664 00000100:00100000:1.0:1782727391.728205:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912481664 00000100:00100000:1.0:1782727391.728268:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1782727391.728278:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912481664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727391.728336:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912481664:12345-0@lo:400:kworker.0 Request processed in 59us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727391.728344:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1782727391.728404:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912481664:0@lo:400:kworker.0 00000100:00100000:1.0:1782727391.728432:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912481920 00000100:00100000:1.0:1782727391.728436:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912481920 00000100:00100000:1.0:1782727391.728479:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912481792 00000100:00100000:1.0:1782727391.728482:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912481792 00000100:00100000:1.0:1782727391.728503:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782727391.728510:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912481920:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782727391.728740:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727391.728764:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782727391.728774:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912481792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727391.728827:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912481792:12345-0@lo:400:kworker.0 Request processed in 56us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727391.728834:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782727391.728865:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912481792:0@lo:400:kworker.0 00000100:00100000:2.0:1782727391.729315:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3447:1869324912482048:0@lo:400:kworker.0 00000100:00100000:2.0:1782727391.729355:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727391.729390:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912482048 00000100:00100000:2.0:1782727391.729394:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912482048 00000100:00080000:2.0:1782727391.729413:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727391.729441:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782727391.729449:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1869324912482048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727391.729484:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1869324912482048:12345-0@lo:400:kworker.0 Request processed in 36us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727391.729491:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782727391.729521:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3447:1869324912482048:0@lo:400:kworker.0 00000100:00100000:1.0:1782727391.730269:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912481920:12345-0@lo:400:kworker.0 Request processed in 1754us (2438us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727391.730278:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782727391.730354:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912481920:0@lo:400:kworker.0 00000100:00100000:2.0:1782727391.730586:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912482176:0@lo:400:kworker.0 00000100:00100000:2.0:1782727391.730640:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727391.730836:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912482176 00000100:00100000:3.0:1782727391.730842:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912482176 00000100:00100000:3.0:1782727391.730996:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782727391.731016:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7528c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912482176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727391.731082:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7528c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912482176:12345-0@lo:400:kworker.0 Request processed in 69us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727391.731090:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1782727391.731277:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e52f800 x1869324912482176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727391.731290:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912482176:0@lo:400:kworker.0 00000100:00080000:2.0:1782727391.731605:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782727391.983340:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782727392.239385:0:8327:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 296415453589ns, next at 297415450076ns, rc = 0 00000100:00100000:1.0:1782727392.239495:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912482304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727392.239599:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727392.240099:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912482304 00000100:00100000:0.0:1782727392.240110:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912482304 00000100:00100000:0.0:1782727392.240178:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782727392.240189:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912482304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727392.240241:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727392.240373:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912482304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727392.240381:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1782727392.246839:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cef7e52ca80 x1869324912482304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727392.246891:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912482304:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1782727392.754867:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1782727392.755007:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1782727392.755022:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1782727392.757560:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912482432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782727392.757668:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727392.757895:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912482432 00000100:00100000:1.0:1782727392.757905:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912482432 00000100:00100000:1.0:1782727392.758010:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727392.758021:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912482432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782727392.758072:0:6940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1782727392.758123:0:6940:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a4242da, atime: 0x6a4242da, ctime: 0x6a4242da, blocks: 0x0 00010000:00010000:1.0:1782727392.758133:0:6940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085793df4/0x9832bf6cd8a43079 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727392.758155:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1782727392.758160:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727392.758168:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085793df4/0x9832bf6cd8a43079 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727392.758189:0:6940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085793df4/0x9832bf6cd8a43079 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727392.758201:0:6940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085793df4/0x9832bf6cd8a43079 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727392.758224:0:6940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085793df4/0x9832bf6cd8a43079 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727392.758247:0:6940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782727392.758654:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727392.758665:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085793df4/0x9832bf6cd8a43079 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727392.758675:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da4600 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:3.0:1782727392.758681:0:6954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085793df4/0x9832bf6cd8a43079 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727392.758701:0:6954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085793df4/0x9832bf6cd8a43079 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727392.758730:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085793df4/0x9832bf6cd8a43079 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727392.758739:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085793df4/0x9832bf6cd8a43079 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727392.758771:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727392.758774:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727392.758776:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727392.762730:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3446:x1869324912482432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4694us (5047us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782727392.762750:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1782727392.765429:0:3446:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cef77f50a80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1782727392.765454:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912482432:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782727393.010202:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727393.572697:0:12267:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync ============================================================= 06:03:11 (1782727391) 00010000:00010000:2.0:1782727394.037622:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727394.834770:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727394.834895:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893570432 00000100:00100000:2.0:1782727394.834906:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893570432 00000100:00100000:2.0:1782727394.835492:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:2.0:1782727394.835504:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:10930:x1869324893570432:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:2.0:1782727394.835524:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727394.835546:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a24f expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.835608:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a43087 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.835622:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a43087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.835635:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a43087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727394.835685:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727394.835689:0:9207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727394.835722:0:9207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a43087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.835746:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a24f expref: 7 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.835765:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a43087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a24f expref: 6 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.835786:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296800) 00010000:00010000:2.0:1782727394.835789:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727394.835808:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f20800, rc 0) 00000100:00100000:2.0:1782727394.835871:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10930:x1869324893570432:12345-192.168.204.23@tcp:101:dd.0 Request processed in 370us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727394.835879:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00080000:3.0:1782727394.841244:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727394.841793:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727394.841864:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893570688 00000100:00100000:2.0:1782727394.841874:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893570688 00000100:00100000:1.0:1782727394.841986:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:1.0:1782727394.842000:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10930:x1869324893570688:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:1.0:1782727394.842023:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727394.842026:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782727394.842052:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a43087 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a24f expref: 6 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.842070:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296800) 00010000:00010000:1.0:1782727394.842082:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727394.842098:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4400/0x9832bf6cd8a4308e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a256 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.842365:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a43095 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.842378:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a43095 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.842387:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a43095 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.842440:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.842455:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.842463:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782727394.843073:0:5954:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1782727394.843231:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a430a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843241:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a430a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843249:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a430a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843281:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a43095 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843288:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a43095 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843294:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a43095 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843301:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da4000 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727394.843305:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a43095 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843323:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a43095 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843335:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8300) 00010000:00010000:1.0:1782727394.843338:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727394.843343:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a43095 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843355:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a43095 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727394.843367:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000570da78f reply state 00000000742aef56 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727394.843376:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782727394.843405:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4400/0x9832bf6cd8a4308e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a256 expref: 8 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843422:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a430a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a256 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.843429:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cef51af8900) 00010000:00010000:1.0:1782727394.843431:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782727394.843433:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5400, rc 0) 00000100:00100000:1.0:1782727394.843512:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:10930:x1869324893570688:12345-192.168.204.23@tcp:101:dd.0 Request processed in 1515us (1723us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782727394.843520:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00010000:00010000:0.0:1782727394.848476:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727394.848496:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727394.848504:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727394.848520:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da4800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727394.848524:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727394.848532:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727394.848547:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff8cef51af8700) 00010000:00010000:0.0:1782727394.848550:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727394.848554:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727394.848561:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a4309c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727394.862595:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727394.862689:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893570816 00000100:00100000:2.0:1782727394.862699:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893570816 00000100:00100000:2.0:1782727394.862754:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:2.0:1782727394.862763:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2335:x1869324893570816:12345-192.168.204.23@tcp:8:dd.0 00010000:00080000:2.0:1782727394.862794:0:6941:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from 4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:2.0:1782727394.862825:0:6941:0:(genops.c:1406:class_connect()) connect: client 4c9ff188-fb9c-4b39-a5ed-2408b1373248, cookie 0x9832bf6cd8a430b1 00002000:00100000:2.0:1782727394.862838:0:6941:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c9ff188-fb9c-4b39-a5ed-2408b1373248/ffff8cef7e0bd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782727394.862856:0:6941:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782727394.862967:0:6941:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782727394.862995:0:6941:0:(import.c:65:import_set_state_nolock()) ffff8cef7e0bf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727394.863083:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2335:x1869324893570816:12345-192.168.204.23@tcp:8:dd.0 Request processed in 319us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727394.863090:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:2.0:1782727394.867313:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727394.867414:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893570944 00000100:00100000:1.0:1782727394.867424:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893570944 00000100:00100000:1.0:1782727394.867591:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:1.0:1782727394.867602:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10930:x1869324893570944:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:1.0:1782727394.867621:0:6940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727394.867649:0:6940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041464a1d/0x9832bf6cd8a430b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a25d expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782727394.867676:0:6940:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782727394.867700:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=299s v=(0 0) 00010000:00010000:1.0:1782727394.867705:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727394.867715:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041464a1d/0x9832bf6cd8a430b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a25d expref: 7 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.867736:0:6940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041464a1d/0x9832bf6cd8a430b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a25d expref: 7 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727394.867749:0:6940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da4000, rc 0) 00000100:00100000:1.0:1782727394.867806:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10930:x1869324893570944:12345-192.168.204.23@tcp:101:dd.0 Request processed in 206us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727394.867815:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00080000:2.0:1782727394.867855:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727394.878465:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727394.878549:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893571200 00000100:00100000:3.0:1782727394.878559:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893571200 00000100:00100000:3.0:1782727394.878634:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:3.0:1782727394.878645:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10930:x1869324893571200:12345-192.168.204.23@tcp:35:dd.0 00000100:00100000:3.0:1782727394.878986:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:10930:x1869324893571200:12345-192.168.204.23@tcp:35:dd.0 Request processed in 342us (530us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782727394.878994:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:3.0:1782727394.920882:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727394.921125:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893571328 00000100:00100000:3.0:1782727394.921143:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893571328 00000100:00100000:3.0:1782727394.921198:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:3.0:1782727394.921209:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:10931:x1869324893571328:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:3.0:1782727394.921235:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727394.921258:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a264 expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.921326:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a430c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.921341:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a430c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.921352:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a430c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727394.921396:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727394.921399:0:9207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727394.921419:0:9207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a430c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.921442:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a264 expref: 10 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.921459:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a430c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a264 expref: 9 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.921468:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800dee00) 00010000:00010000:3.0:1782727394.921471:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727394.921474:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41525600, rc 0) 00000100:00100000:3.0:1782727394.921536:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:10931:x1869324893571328:12345-192.168.204.23@tcp:101:rm.0 Request processed in 329us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727394.921543:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:1.0:1782727394.938292:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727394.945377:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893571584 00000100:00100000:3.0:1782727394.945393:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893571584 00000100:00100000:3.0:1782727394.945506:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:3.0:1782727394.945517:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:10931:x1869324893571584:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:3.0:1782727394.945576:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782727394.945602:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a430a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a256 expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.945620:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cef51af8900) 00010000:00010000:3.0:1782727394.945636:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a430c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a264 expref: 8 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.945651:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800dee00) 00010000:00010000:3.0:1782727394.945660:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727394.945684:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.945697:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.945707:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.945719:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.945725:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.945742:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.945825:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a430db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.945832:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a430db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.945839:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a430db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782727394.946098:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1782727394.946108:0:5951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 299122179431ns, next at 300122177412ns, rc = 0 00010000:00010000:3.0:1782727394.946158:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946167:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946174:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946181:0:5951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946187:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946193:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946221:0:5951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782727394.946239:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a430db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946246:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a430db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946252:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a430db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946258:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41524c00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727394.946262:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a430db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946270:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a430db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946279:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cef800de600) 00010000:00010000:3.0:1782727394.946282:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782727394.946285:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a430db lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946291:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a430db lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946306:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946313:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946319:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946331:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525e00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727394.946334:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946341:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946350:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800deb00) 00010000:00010000:3.0:1782727394.946353:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727394.946355:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.946360:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a430cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727394.946384:0:5951:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000473c2219 reply state 000000005f66610e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727394.946394:0:5951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782727394.946471:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:10931:x1869324893571584:12345-192.168.204.23@tcp:36:rm.0 Request processed in 954us (8186us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1782727394.946479:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00010000:00010000:2.0:1782727394.956032:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727394.956045:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.956068:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525400 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:2.0:1782727394.956073:0:6954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.956082:0:6954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.956100:0:6954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cef800de600) 00010000:00010000:2.0:1782727394.956103:0:6954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782727394.956109:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.956114:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a430e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727394.956134:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727394.956136:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727394.956138:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727394.958685:0:3431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.958703:0:3431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.958710:0:3431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.958733:0:3431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41524400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727394.958737:0:3431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.958745:0:3431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.958762:0:3431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff8cef800de400) 00010000:00010000:3.0:1782727394.958765:0:3431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727394.958768:0:3431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727394.958774:0:3431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a430d4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727395.055329:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727395.106011:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727395.106194:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893571712 00000100:00100000:3.0:1782727395.106203:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893571712 00000100:00100000:3.0:1782727395.106273:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:3.0:1782727395.106283:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:10934:x1869324893571712:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1782727395.106307:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727395.106330:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486c00/0x9832bf6cd8a430e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a26b expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727395.106400:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a430f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727395.106413:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a430f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727395.106442:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a430f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727395.106707:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727395.106711:0:9207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727395.106750:0:9207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a430f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727395.106905:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486c00/0x9832bf6cd8a430e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a26b expref: 10 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727395.107214:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a430f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a26b expref: 9 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727395.107225:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800de400) 00010000:00010000:3.0:1782727395.107228:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727395.107232:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41487600, rc 0) 00000100:00100000:3.0:1782727395.107305:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:10934:x1869324893571712:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1022us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727395.107314:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:3.0:1782727395.115112:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727395.115328:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893571968 00000100:00100000:2.0:1782727395.115338:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893571968 00000100:00100000:2.0:1782727395.115400:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:2.0:1782727395.115410:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:10934:x1869324893571968:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1782727395.115430:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727395.115433:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782727395.115460:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a430f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a26b expref: 9 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.115562:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800de400) 00010000:00010000:2.0:1782727395.115574:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727395.115604:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a430f7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a272 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.115718:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a430fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.115731:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a430fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.115740:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a430fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.115751:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.115757:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.115763:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782727395.117460:0:5954:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1782727395.117915:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21a00/0x9832bf6cd8a4310c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.117960:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21a00/0x9832bf6cd8a4310c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.117971:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21a00/0x9832bf6cd8a4310c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.118024:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a430fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.118058:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a430fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.118064:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a430fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.118070:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f20800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727395.118075:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a430fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.118082:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a430fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.118093:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296600) 00010000:00010000:2.0:1782727395.118097:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727395.118101:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a430fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.118107:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a430fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727395.118123:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033a1346a reply state 00000000188cc08c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727395.118132:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782727395.118164:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a430f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a272 expref: 11 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.118183:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21a00/0x9832bf6cd8a4310c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a272 expref: 10 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.118201:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cef49296900) 00010000:00010000:2.0:1782727395.118203:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727395.118206:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f21a00, rc 0) 00000100:00100000:2.0:1782727395.118292:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+11:10934:x1869324893571968:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2882us (3189us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1782727395.118302:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00010000:00010000:1.0:1782727395.129762:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727395.129790:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727395.129817:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727395.129824:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f20600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727395.129830:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727395.129838:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727395.129853:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff8cef49296b00) 00010000:00010000:1.0:1782727395.129856:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727395.129861:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727395.129868:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43105 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727395.141307:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727395.141604:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893572096 00000100:00100000:0.0:1782727395.141614:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893572096 00000100:00100000:0.0:1782727395.141691:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:0.0:1782727395.141701:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:10934:x1869324893572096:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1782727395.141720:0:6938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727395.141743:0:6938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fddce02/0x9832bf6cd8a4311a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a279 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782727395.141770:0:6938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782727395.141804:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=299s v=(0 0) 00010000:00010000:0.0:1782727395.141809:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782727395.141818:0:6938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fddce02/0x9832bf6cd8a4311a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a279 expref: 6 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727395.141853:0:6938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000fddce02/0x9832bf6cd8a4311a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a279 expref: 6 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727395.141866:0:6938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef82045e00, rc 0) 00000100:00100000:0.0:1782727395.141972:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10934:x1869324893572096:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 271us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727395.141979:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00080000:2.0:1782727395.142314:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727395.171133:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727395.171273:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893572224 00000100:00100000:3.0:1782727395.171283:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893572224 00000100:00100000:3.0:1782727395.171390:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:3.0:1782727395.171400:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:10934:x1869324893572224:12345-192.168.204.23@tcp:44:multiop.0 00000001:00080000:1.0:1782727395.179451:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000004:00080000:1.0:1782727395.179479:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1782727395.179806:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10934:x1869324893572224:12345-192.168.204.23@tcp:44:multiop.0 Request processed in 8397us (8671us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727395.179825:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:0.0:1782727395.180155:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727395.180174:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912482560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782727395.180226:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727395.180835:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912482560 00000100:00100000:1.0:1782727395.180844:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912482560 00000100:00100000:1.0:1782727395.180898:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727395.180907:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912482560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782727395.180969:0:6940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00010000:00010000:1.0:1782727395.180995:0:6940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727395.181015:0:6940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041464a1d/0x9832bf6cd8a430b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a25d expref: 6 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727395.181049:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727395.181053:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727395.181057:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727395.181091:0:6940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041464a1d/0x9832bf6cd8a430b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a25d expref: 6 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727395.181107:0:6940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041464a1d/0x9832bf6cd8a430b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a25d expref: 6 pid: 6940 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727395.181119:0:6940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6940:1869324912482688:192.168.204.23@tcp:104: 00000100:00100000:1.0:1782727395.181186:0:6940:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef58670c00 going to sleep for 11 seconds 00000100:00080000:3.0:1782727395.182590:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727395.190218:0:6940:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6940:1869324912482688:192.168.204.23@tcp:104: 00010000:00010000:1.0:1782727395.190253:0:6940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727395.192172:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727395.192785:0:6941:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782727395.192800:0:6941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1782727395.193736:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893572352 00000100:00100000:2.0:1782727395.193752:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893572352 00000100:00100000:3.0:1782727395.194049:0:12329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:3.0:1782727395.194065:0:12329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893572352:12345-192.168.204.23@tcp:16:multiop.0 00000100:00100000:3.0:1782727395.194591:0:12329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893572352:12345-192.168.204.23@tcp:16:multiop.0 Request processed in 526us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727395.194601:0:12329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:0.0:1782727395.203086:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727395.203290:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893572480 00000100:00100000:2.0:1782727395.203303:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893572480 00010000:00010000:2.0:1782727395.203361:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041464a1d/0x9832bf6cd8a430b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a25d expref: 7 pid: 6940 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727395.203417:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:2.0:1782727395.203428:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2337:x1869324893572480:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782727395.203449:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727395.203455:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041464a1d/0x9832bf6cd8a430b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a25d expref: 7 pid: 6940 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.203470:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041464a1d/0x9832bf6cd8a430b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a25d expref: 7 pid: 6940 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.203503:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041464a1d/0x9832bf6cd8a430b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a25d expref: 7 pid: 6940 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.203556:0:6955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782727395.203562:0:6955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782727395.203569:0:6955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.203580:0:6955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.203626:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727395.203703:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893572480:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 276us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727395.203712:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00010000:00010000:0.0:1782727395.204304:0:6940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727395.204318:0:6940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727395.204331:0:6940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727395.204340:0:6940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727395.204376:0:6940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782727395.204622:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3446:x1869324912482560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23714us (24393us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782727395.204631:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1782727395.204706:0:3446:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cef6c9ae300/2, rc 0, transno 4294967299 00000100:00100000:0.0:1782727395.204713:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912482560:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782727395.206554:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727395.206571:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.206587:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da5c00 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:2.0:1782727395.206592:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.206604:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.206631:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.206665:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bd89a0c/0x9832bf6cd8a43121 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727395.206700:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727395.206702:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727395.206704:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727395.219891:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727395.220835:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893572736 00000100:00100000:3.0:1782727395.220850:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893572736 00000100:00100000:3.0:1782727395.220990:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1782727395.221019:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:10934:x1869324893572736:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1782727395.221789:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:10934:x1869324893572736:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 770us (1910us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1782727395.221801:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:2.0:1782727395.802485:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727395.802872:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893572864 00000100:00100000:3.0:1782727395.802886:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893572864 00000100:00100000:3.0:1782727395.803022:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 240 00000100:00100000:3.0:1782727395.803035:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893572864:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727395.803305:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2338:x1869324893572864:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 271us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727395.803314:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 240 00010000:00010000:2.0:1782727396.083127:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727396.336311:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912482816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727396.336430:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727396.336531:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912482816 00000100:00100000:0.0:1782727396.336543:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912482816 00000100:00100000:0.0:1782727396.336625:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782727396.336638:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324912482816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727396.336675:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727396.336756:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324912482816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727396.336765:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782727396.336800:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912482816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727396.848433:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912483200:0@lo:400:kworker.0 00000100:00100000:2.0:1782727396.848546:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727396.848632:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782727396.848639:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912483072:0@lo:400:kworker.0 00000100:00100000:2.0:1782727396.848665:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727396.848685:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912483584:0@lo:400:kworker.0 00000100:00100000:2.0:1782727396.848713:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727396.848755:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912483584 00000100:00100000:2.0:1782727396.848764:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912483584 00000100:00100000:2.0:1782727396.848842:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782727396.848853:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912483584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727396.848967:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912483584:12345-0@lo:400:kworker.0 Request processed in 115us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727396.848975:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782727396.849030:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912483584:0@lo:400:kworker.0 00000100:00100000:2.0:1782727396.849072:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912483200 00000100:00100000:2.0:1782727396.849075:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912483200 00000100:00100000:2.0:1782727396.849109:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912483072 00000100:00100000:2.0:1782727396.849112:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912483072 00000100:00100000:2.0:1782727396.849132:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782727396.849138:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912483200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727396.849177:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912483200:12345-0@lo:400:kworker.0 Request processed in 39us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727396.849184:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782727396.849196:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782727396.849202:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912483072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727396.849230:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912483072:12345-0@lo:400:kworker.0 Request processed in 28us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727396.849236:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782727396.849261:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912483072:0@lo:400:kworker.0 00000100:00100000:2.0:1782727396.849272:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912483200:0@lo:400:kworker.0 00000100:00100000:0.0:1782727396.849503:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912483328:0@lo:400:kworker.0 00000100:00100000:0.0:1782727396.849552:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727396.849582:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782727396.849588:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912482944:0@lo:400:kworker.0 00000100:00100000:0.0:1782727396.849618:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727396.849644:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912483456:0@lo:400:kworker.0 00000100:00100000:0.0:1782727396.849667:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727396.849694:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912482944 00000100:00100000:0.0:1782727396.849699:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912482944 00000100:00100000:0.0:1782727396.849731:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782727396.849739:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3444:x1869324912482944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727396.849787:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3444:x1869324912482944:12345-0@lo:400:kworker.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727396.849794:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782727396.849829:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912483456 00000100:00100000:0.0:1782727396.849833:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912483456 00000100:00100000:0.0:1782727396.849861:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782727396.849867:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912483456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727396.849898:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912483456:12345-0@lo:400:kworker.0 Request processed in 30us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727396.849913:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782727396.849966:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c805432-a345-4b8b-859c-fa0b2938956c:3444:1869324912482944:0@lo:400:kworker.0 00000100:00100000:0.0:1782727396.849977:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912483456:0@lo:400:kworker.0 00000100:00100000:2.0:1782727396.850240:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912483328 00000100:00100000:2.0:1782727396.850245:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912483328 00000100:00100000:2.0:1782727396.850282:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727396.850289:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324912483328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727396.850326:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324912483328:12345-0@lo:400:kworker.0 Request processed in 38us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727396.850332:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1782727396.850482:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727396.850488:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727396.850756:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912483328:0@lo:400:kworker.0 00010000:00010000:0.0:1782727397.103330:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727397.359454:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727397.359489:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912483712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727397.359613:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727397.359888:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912483712 00000100:00100000:0.0:1782727397.359908:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912483712 00000100:00100000:0.0:1782727397.360024:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782727397.360038:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3446:x1869324912483712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727397.360081:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727397.360148:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3446:x1869324912483712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727397.360159:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782727397.360850:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912483712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782727398.127402:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782727398.921089:0:8023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1782727399.154329:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727400.175662:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727400.931380:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727400.931421:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727400.931497:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727400.931522:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727400.931550:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893572992 00000100:00100000:3.0:1782727400.931560:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893572992 00000100:00100000:3.0:1782727400.931612:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 242 00000100:00100000:3.0:1782727400.931622:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2339:x1869324893572992:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727400.931695:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2339:x1869324893572992:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 73us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727400.931703:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 242 00000100:00100000:3.0:1782727400.931737:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893573248 00000100:00100000:3.0:1782727400.931740:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893573248 00000100:00100000:3.0:1782727400.931774:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893573376 00000100:00100000:3.0:1782727400.931777:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893573376 00000100:00100000:3.0:1782727400.931811:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1782727400.931818:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2339:x1869324893573248:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727400.931858:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2339:x1869324893573248:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 41us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727400.931865:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1782727400.931877:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:3.0:1782727400.931883:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2339:x1869324893573376:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727400.931918:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2339:x1869324893573376:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 35us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727400.931925:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00080000:3.0:1782727400.932399:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727400.932403:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727400.932507:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893573120 00000100:00100000:0.0:1782727400.932519:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893573120 00000100:00100000:0.0:1782727400.932576:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 108 00000100:00100000:0.0:1782727400.932583:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2339:x1869324893573120:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727400.932631:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2339:x1869324893573120:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 48us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727400.932637:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 108 00000100:00080000:3.0:1782727400.933428:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1782727400.956122:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000001:00080000:1.0:1782727400.970252:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1782727400.970284:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c9ff188-fb9c-4b39-a5ed-2408b1373248 00010000:00010000:2.0:1782727401.202571:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727401.394724:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727401.395065:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893573504 00000100:00100000:0.0:1782727401.395080:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893573504 00000100:00100000:0.0:1782727401.395187:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:0.0:1782727401.395217:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:11172:x1869324893573504:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1782727401.395238:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727401.395285:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045600/0x9832bf6cd8a43128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a280 expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.395360:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044e00/0x9832bf6cd8a4312f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.395375:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044e00/0x9832bf6cd8a4312f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.395389:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044e00/0x9832bf6cd8a4312f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727401.395481:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727401.395486:0:9207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727401.395525:0:9207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044e00/0x9832bf6cd8a4312f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.395551:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045600/0x9832bf6cd8a43128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a280 expref: 8 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.395594:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044e00/0x9832bf6cd8a4312f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a280 expref: 7 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.395603:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9be00) 00010000:00010000:0.0:1782727401.395605:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727401.395608:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef82044e00, rc 0) 00000100:00100000:0.0:1782727401.395676:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:11172:x1869324893573504:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 469us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727401.395684:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:0.0:1782727401.403291:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727401.403600:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893573632 00000100:00100000:2.0:1782727401.403611:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893573632 00000100:00100000:2.0:1782727401.403706:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:2.0:1782727401.403717:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:11172:x1869324893573632:12345-192.168.204.23@tcp:41:lfs.0 00000004:00000024:2.0:1782727401.403756:0:5953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1782727401.403841:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:11172:x1869324893573632:12345-192.168.204.23@tcp:41:lfs.0 Request processed in 125us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727401.403849:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:3.0:1782727401.412105:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727401.412261:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893573760 00000100:00100000:0.0:1782727401.412272:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893573760 00000100:00100000:0.0:1782727401.412356:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:0.0:1782727401.412367:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:11172:x1869324893573760:12345-192.168.204.23@tcp:13:lfs.0 00002000:00000024:0.0:1782727401.412407:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727401.413276:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:11172:x1869324893573760:12345-192.168.204.23@tcp:13:lfs.0 Request processed in 136us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727401.413288:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:3.0:1782727401.416618:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727401.418375:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893573888 00000100:00100000:1.0:1782727401.418392:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893573888 00000100:00100000:1.0:1782727401.418670:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:1.0:1782727401.418683:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:11172:x1869324893573888:12345-192.168.204.23@tcp:13:lfs.0 00002000:00000024:1.0:1782727401.418724:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727401.418856:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:11172:x1869324893573888:12345-192.168.204.23@tcp:13:lfs.0 Request processed in 175us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727401.418863:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:1.0:1782727401.455468:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912483840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727401.455544:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727401.455910:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912483840 00000100:00100000:0.0:1782727401.455946:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912483840 00000100:00100000:0.0:1782727401.456007:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782727401.456017:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912483840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727401.456043:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727401.456095:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912483840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727401.456112:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782727401.456154:0:3444:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000004:00080000:0.0:1782727401.456159:0:3444:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cef6c9ae300, transno 4294967299 00000100:00100000:0.0:1782727401.456174:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912483840:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782727401.456511:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727401.967206:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912484096:0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.967291:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727401.967347:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912484608:0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.967375:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727401.967406:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727401.967412:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912484224:0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.967436:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727401.967469:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912484096 00000100:00100000:0.0:1782727401.967477:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912484096 00000100:00100000:0.0:1782727401.967525:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912484224 00000100:00100000:0.0:1782727401.967528:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912484224 00000100:00100000:0.0:1782727401.967565:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782727401.967574:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912484096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.967646:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912484096:12345-0@lo:400:kworker.0 Request processed in 58us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727401.967654:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782727401.967674:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782727401.967681:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912484224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.967708:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912484224:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727401.967714:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782727401.967745:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912484608 00000100:00100000:0.0:1782727401.967749:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912484608 00000100:00100000:0.0:1782727401.967792:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782727401.967798:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912484608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.967845:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912484608:12345-0@lo:400:kworker.0 Request processed in 47us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727401.967852:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1782727401.967870:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727401.967875:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727401.967924:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912484224:0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.967968:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912484096:0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.967981:0:3446:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1782727401.967987:0:3446:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cef77f50a80, transno 4294967300 00000100:00100000:0.0:1782727401.967999:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912484608:0@lo:400:kworker.0 00000100:00100000:2.0:1782727401.968279:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912483968:0@lo:400:kworker.0 00000100:00100000:2.0:1782727401.968323:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727401.968363:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912484480:0@lo:400:kworker.0 00000100:00100000:2.0:1782727401.968390:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727401.968462:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727401.968469:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912484352:0@lo:400:kworker.0 00000100:00100000:2.0:1782727401.968494:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727401.968524:0:12329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912484352 00000100:00100000:2.0:1782727401.968528:0:12329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912484352 00000100:00100000:2.0:1782727401.968554:0:12329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782727401.968561:0:12329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912484352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727401.968600:0:12329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912484352:12345-0@lo:400:kworker.0 Request processed in 40us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727401.968607:0:12329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782727401.968635:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912484352:0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.969746:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912483968 00000100:00100000:0.0:1782727401.969754:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912483968 00000100:00100000:0.0:1782727401.969819:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782727401.969828:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912483968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.969896:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912483968:12345-0@lo:400:kworker.0 Request processed in 69us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727401.969904:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782727401.969967:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912484480 00000100:00100000:0.0:1782727401.969971:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912484480 00000100:00100000:0.0:1782727401.970010:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782727401.970016:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912484480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727401.970049:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912484480:12345-0@lo:400:kworker.0 Request processed in 34us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727401.970070:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1782727401.970105:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727401.970293:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912483968:0@lo:400:kworker.0 00000100:00100000:2.0:1782727401.970306:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912484480:0@lo:400:kworker.0 00010000:00010000:2.0:1782727402.223219:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727402.479851:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912484736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727402.479959:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727402.480179:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912484736 00000100:00100000:0.0:1782727402.480189:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912484736 00000100:00100000:0.0:1782727402.480248:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782727402.480258:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912484736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727402.480282:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727402.480344:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912484736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727402.480350:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782727402.480450:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912484736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727403.247357:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727404.289177:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727405.295187:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727406.046376:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727406.047291:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893574016 00000100:00100000:0.0:1782727406.047316:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893574016 00000100:00100000:0.0:1782727406.047385:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 244 00000100:00100000:0.0:1782727406.047396:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893574016:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727406.047479:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893574016:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 84us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727406.047487:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 244 00000100:00100000:2.0:1782727406.049445:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727406.054531:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893574144 00000100:00100000:0.0:1782727406.054546:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893574144 00000100:00100000:0.0:1782727406.054765:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 112 00000100:00080000:3.0:1782727406.054785:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727406.054789:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2336:x1869324893574144:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727406.054892:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2336:x1869324893574144:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 117us (5456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727406.054901:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 112 00000100:00100000:3.0:1782727406.059112:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727406.059322:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893574272 00000100:00100000:0.0:1782727406.059341:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893574272 00000100:00100000:0.0:1782727406.059410:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:0.0:1782727406.059420:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2336:x1869324893574272:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727406.059499:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2336:x1869324893574272:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 80us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727406.059507:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00080000:3.0:1782727406.059896:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727406.059897:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727406.060293:0:12329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893574400 00000100:00100000:1.0:1782727406.060299:0:12329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893574400 00000100:00100000:1.0:1782727406.060347:0:12329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:1.0:1782727406.060356:0:12329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893574400:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727406.060402:0:12329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893574400:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 47us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727406.060422:0:12329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00080000:0.0:1782727406.061150:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782727406.319106:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727406.576305:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6c9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912484864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727406.576470:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727406.577280:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912484864 00000100:00100000:2.0:1782727406.577294:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912484864 00000100:00100000:2.0:1782727406.577395:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782727406.577405:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912484864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727406.577542:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727406.577628:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912484864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 224us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727406.577636:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1782727406.577959:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727406.578007:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6c9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912484864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727407.087196:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef6d8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912484992:0@lo:400:kworker.0 00000100:00100000:2.0:1782727407.087279:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727407.087357:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912485504:0@lo:400:kworker.0 00000100:00100000:3.0:1782727407.087363:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912485120:0@lo:400:kworker.0 00000100:00100000:2.0:1782727407.087397:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727407.087423:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912485248:0@lo:400:kworker.0 00000100:00100000:2.0:1782727407.087424:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727407.087433:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912485376:0@lo:400:kworker.0 00000100:00100000:3.0:1782727407.087455:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727407.087469:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727407.087494:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727407.087516:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912485632:0@lo:400:kworker.0 00000100:00100000:3.0:1782727407.087534:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727407.087576:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912485504 00000100:00100000:3.0:1782727407.087582:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912485504 00000100:00100000:3.0:1782727407.087630:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912485248 00000100:00100000:3.0:1782727407.087633:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912485248 00000100:00100000:3.0:1782727407.087646:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912485120 00000100:00100000:3.0:1782727407.087648:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912485120 00000100:00100000:3.0:1782727407.087660:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782727407.087667:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912485504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727407.087719:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912485376 00000100:00100000:2.0:1782727407.087724:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912485376 00000100:00100000:3.0:1782727407.087734:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912485504:12345-0@lo:400:kworker.0 Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727407.087756:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912485632 00000100:00100000:2.0:1782727407.087761:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912485632 00000100:00100000:2.0:1782727407.087792:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782727407.087798:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912485376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727407.087834:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912485376:12345-0@lo:400:kworker.0 Request processed in 37us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727407.087853:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782727407.087873:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782727407.087880:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912485632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727407.087914:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912485632:12345-0@lo:400:kworker.0 Request processed in 34us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727407.087920:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782727407.087984:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912485376:0@lo:400:kworker.0 00000100:00100000:2.0:1782727407.087996:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912485504:0@lo:400:kworker.0 00000100:00100000:3.0:1782727407.088020:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782727407.088041:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782727407.088050:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912485248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727407.088057:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912485632:0@lo:400:kworker.0 00000100:00100000:3.0:1782727407.088091:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1869324912485248:12345-0@lo:400:kworker.0 Request processed in 42us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727407.088100:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782727407.088110:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3447:1869324912485248:0@lo:400:kworker.0 00000100:00100000:3.0:1782727407.088117:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782727407.088126:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912485120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727407.088374:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912485120:12345-0@lo:400:kworker.0 Request processed in 248us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727407.088381:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782727407.091394:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912484992 00000100:00100000:0.0:1782727407.091411:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912484992 00000100:00100000:0.0:1782727407.091486:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1782727407.091497:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912484992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727407.091599:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912484992:12345-0@lo:400:kworker.0 Request processed in 103us (4321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727407.091608:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1782727407.091670:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727407.091677:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727407.091951:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef6d8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912484992:0@lo:400:kworker.0 00000100:00100000:2.0:1782727407.097612:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912485120:0@lo:400:kworker.0 00010000:00010000:2.0:1782727407.346468:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727407.599366:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727407.599407:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912485760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727407.599525:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727407.600433:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912485760 00000100:00100000:2.0:1782727407.600448:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912485760 00000100:00100000:2.0:1782727407.609002:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727407.609030:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef469ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912485760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727407.609070:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727407.609166:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef469ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912485760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (9642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727407.609175:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782727407.609393:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912485760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727407.616059:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727407.616359:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893574528 00000100:00100000:3.0:1782727407.616369:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893574528 00000100:00100000:3.0:1782727407.616432:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:3.0:1782727407.616442:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:11598:x1869324893574528:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:3.0:1782727407.616462:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727407.616483:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486e00/0x9832bf6cd8a43136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a287 expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.616565:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a4313d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.617054:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a4313d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.617065:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a4313d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.617133:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a43144 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.617142:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a43144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.617148:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a43144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618575:0:9207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a4313d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618591:0:9207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a4313d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618600:0:9207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a4313d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618607:0:9207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41487600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727407.618611:0:9207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a4313d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618700:0:9207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a4313d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618721:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9be00) 00010000:00010000:3.0:1782727407.618738:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727407.618744:0:9207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a4313d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618751:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a4313d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618772:0:9207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a43144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618778:0:9207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a43144 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618785:0:9207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a43144 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618791:0:9207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41486200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727407.618794:0:9207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a43144 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618800:0:9207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a43144 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618808:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff8cef800deb00) 00010000:00010000:3.0:1782727407.618812:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727407.618815:0:9207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a43144 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618820:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a43144 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618872:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486e00/0x9832bf6cd8a43136 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a287 expref: 8 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618897:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9be00) 00010000:00010000:3.0:1782727407.618899:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782727407.618903:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486e00/0x9832bf6cd8a43136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a287 expref: 8 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727407.618913:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41486e00, rc 0) 00000100:00100000:3.0:1782727407.619088:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:11598:x1869324893574528:12345-192.168.204.23@tcp:101:rm.0 Request processed in 2645us (3037us total) trans 0 rc 301/301 00000100:00100000:3.0:1782727407.619098:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00010000:00010000:2.0:1782727408.367190:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727409.393810:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727410.288662:0:12610:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 118c: Fsync blocks on EROFS until dirty pages are flushed ==================================================================== 06:03:27 (1782727407) 00010000:00010000:2.0:1782727410.415423:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727411.042621:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727411.042812:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893574784 00000100:00100000:0.0:1782727411.042825:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893574784 00000100:00100000:0.0:1782727411.043102:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:0.0:1782727411.043120:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:11848:x1869324893574784:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1782727411.043169:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727411.043173:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782727411.043209:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044e00/0x9832bf6cd8a4312f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a280 expref: 7 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.043233:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9be00) 00010000:00010000:0.0:1782727411.043258:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727411.043278:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045600/0x9832bf6cd8a4314b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a28e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.043420:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044600/0x9832bf6cd8a43152 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.043439:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044600/0x9832bf6cd8a43152 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.043451:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044600/0x9832bf6cd8a43152 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782727411.046446:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727411.056547:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.056582:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.056598:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.059464:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.059515:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.059528:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727411.059544:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:0.0:1782727411.059580:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044600/0x9832bf6cd8a43152 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.059588:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044600/0x9832bf6cd8a43152 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.059595:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044600/0x9832bf6cd8a43152 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.059602:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82044600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727411.059607:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044600/0x9832bf6cd8a43152 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.059615:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044600/0x9832bf6cd8a43152 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.059639:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9bb00) 00010000:00010000:0.0:1782727411.059643:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727411.059647:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044600/0x9832bf6cd8a43152 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.059654:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044600/0x9832bf6cd8a43152 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727411.059672:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067f055b3 reply state 000000007382a218 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727411.060104:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782727411.060155:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045600/0x9832bf6cd8a4314b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a28e expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.060183:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a28e expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.060191:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9b700) 00010000:00010000:0.0:1782727411.060193:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727411.060196:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef82045200, rc 0) 00000100:00100000:0.0:1782727411.060302:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:11848:x1869324893574784:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 17187us (17694us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1782727411.060312:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00010000:00010000:0.0:1782727411.066433:0:3431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.066458:0:3431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.066468:0:3431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.066475:0:3431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef82044000 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727411.066481:0:3431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.066490:0:3431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.066550:0:3431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8cef77d9ba00) 00010000:00010000:0.0:1782727411.066553:0:3431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727411.066559:0:3431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.066566:0:3431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82044000/0x9832bf6cd8a43159 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727411.068237:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727411.068638:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893575040 00000100:00100000:0.0:1782727411.068652:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893575040 00000100:00100000:0.0:1782727411.068741:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:0.0:1782727411.068753:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:11848:x1869324893575040:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1782727411.068786:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727411.068815:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045400/0x9832bf6cd8a4316e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a295 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.069009:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.069028:0:5951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a28e expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.069038:0:5951:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.069086:0:5951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a28e expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.069103:0:5951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a28e expref: 9 pid: 5953 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727411.069140:0:5951:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5951:1869324912485888:192.168.204.23@tcp:104: 00000100:00100000:0.0:1782727411.069663:0:5951:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef787ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1782727411.076019:0:5951:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5951:1869324912485888:192.168.204.23@tcp:104: 00010000:00010000:0.0:1782727411.076061:0:5951:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727411.086414:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727411.086980:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893575168 00000100:00100000:3.0:1782727411.087004:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893575168 00010000:00010000:3.0:1782727411.087063:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a28e expref: 10 pid: 5953 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727411.087304:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:3.0:1782727411.087331:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:2336:x1869324893575168:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782727411.087355:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727411.087478:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a28e expref: 10 pid: 5953 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.087497:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a28e expref: 10 pid: 5953 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.087521:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045200/0x9832bf6cd8a43160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a28e expref: 10 pid: 5953 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.087561:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9b700) 00010000:00010000:3.0:1782727411.087566:0:5937:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.087575:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.087583:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.087620:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727411.087674:0:5951:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727411.087704:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:2336:x1869324893575168:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 383us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727411.087713:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00010000:00010000:0.0:1782727411.088581:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727411.088608:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00000004:00080000:0.0:1782727411.089523:0:5951:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00000004:00080000:0.0:1782727411.089535:0:5951:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1782727411.090115:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.090128:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.090137:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.090142:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727411.090148:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.090156:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.090189:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9b700) 00010000:00010000:0.0:1782727411.090192:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782727411.090198:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.090205:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43175 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.090293:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045400/0x9832bf6cd8a4316e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a295 expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.090305:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9b300) 00010000:00010000:0.0:1782727411.090308:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782727411.090311:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef82045400/0x9832bf6cd8a4316e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a295 expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.090326:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef82045400, rc 0) 00000100:00100000:0.0:1782727411.090430:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:11848:x1869324893575040:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 21678us (22203us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1782727411.090440:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:1.0:1782727411.098470:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727411.098718:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893575424 00000100:00100000:3.0:1782727411.098731:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893575424 00000100:00100000:3.0:1782727411.098817:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:3.0:1782727411.098830:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:11848:x1869324893575424:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1782727411.100379:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:11848:x1869324893575424:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 1533us (1898us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1782727411.100393:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:1.0:1782727411.112508:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727411.114771:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893575552 00000100:00100000:0.0:1782727411.114785:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893575552 00000100:00100000:0.0:1782727411.114876:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:0.0:1782727411.114886:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:11848:x1869324893575552:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1782727411.114912:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727411.114971:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43183 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a29c expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.115065:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a29c expref: 10 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.115081:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a29c expref: 10 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.115101:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9b300) 00010000:00010000:0.0:1782727411.115293:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782727411.115297:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273600, rc 0) 00000100:00100000:0.0:1782727411.115379:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:11848:x1869324893575552:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 493us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727411.115387:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:1.0:1782727411.126607:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727411.126779:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893575808 00000100:00100000:0.0:1782727411.126788:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893575808 00000100:00100000:0.0:1782727411.126863:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1782727411.126874:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:11848:x1869324893575808:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1782727411.127153:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+11:11848:x1869324893575808:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 280us (556us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1782727411.127161:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:3.0:1782727411.154087:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727411.155030:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893575936 00000100:00100000:2.0:1782727411.155056:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893575936 00000100:00100000:2.0:1782727411.155138:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:2.0:1782727411.155150:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6d8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+11:11849:x1869324893575936:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:2.0:1782727411.155177:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727411.155202:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a4318a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2a3 expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.155271:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43191 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.155285:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.155297:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727411.155344:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727411.155348:0:9207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727411.155379:0:9207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.155405:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a4318a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2a3 expref: 13 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.155424:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43191 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2a3 expref: 12 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.155452:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296c00) 00010000:00010000:2.0:1782727411.155455:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727411.155458:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f21400, rc 0) 00000100:00100000:2.0:1782727411.155530:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6d8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+12:11849:x1869324893575936:12345-192.168.204.23@tcp:101:dd.0 Request processed in 381us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727411.155537:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:1.0:1782727411.169608:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727411.169867:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727411.169898:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727411.169980:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727411.169988:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893576320 00000100:00100000:2.0:1782727411.170006:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893576320 00000100:00080000:1.0:1782727411.170081:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727411.170084:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893576192 00000100:00100000:2.0:1782727411.170089:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893576192 00000100:00100000:1.0:1782727411.170125:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:3.0:1782727411.170209:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893576576 00000100:00100000:3.0:1782727411.170217:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893576576 00000100:00100000:1.0:1782727411.170281:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2339:x1869324893576320:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727411.170384:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2339:x1869324893576320:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 108us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727411.170484:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1782727411.170493:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+12:11849:x1869324893576576:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:3.0:1782727411.170553:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727411.170556:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782727411.170592:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43191 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2a3 expref: 12 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.170618:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296c00) 00010000:00010000:3.0:1782727411.170643:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727411.170665:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486e00/0x9832bf6cd8a43198 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2aa expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.170855:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a4319f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.170872:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a4319f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.170884:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a4319f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.170897:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a431a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.170903:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a431a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.170909:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a431a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171049:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486400/0x9832bf6cd8a431ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171071:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486400/0x9832bf6cd8a431ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171079:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486400/0x9832bf6cd8a431ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727411.171091:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:3.0:1782727411.171197:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a4319f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171206:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a4319f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171213:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a4319f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171219:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41486200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727411.171225:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a4319f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171232:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a4319f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171242:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800dea00) 00010000:00010000:3.0:1782727411.171244:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727411.171248:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a4319f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171255:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486200/0x9832bf6cd8a4319f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171268:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a431a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171280:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a431a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171286:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a431a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171290:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41487600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727411.171293:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a431a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171299:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a431a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171307:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8cef800def00) 00010000:00010000:3.0:1782727411.171309:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727411.171311:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a431a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171317:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41487600/0x9832bf6cd8a431a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171364:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486e00/0x9832bf6cd8a43198 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2aa expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171381:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486400/0x9832bf6cd8a431ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2aa expref: 13 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.171389:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9b300) 00010000:00010000:3.0:1782727411.171391:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727411.171399:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41486400, rc 0) 00000100:00100000:3.0:1782727411.171444:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+13:11849:x1869324893576576:12345-192.168.204.23@tcp:101:dd.0 Request processed in 951us (1463us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1782727411.171453:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:2.0:1782727411.174805:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:2.0:1782727411.174903:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2339:x1869324893576192:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1782727411.175035:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2339:x1869324893576192:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 216us (5133us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727411.175045:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00080000:3.0:1782727411.177159:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727411.177315:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893576064 00000100:00100000:0.0:1782727411.177330:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893576064 00000100:00100000:0.0:1782727411.177402:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 246 00000100:00100000:0.0:1782727411.177414:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2339:x1869324893576064:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727411.177639:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2339:x1869324893576064:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 225us (8045us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727411.177670:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 246 00000100:00100000:3.0:1782727411.183690:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727411.183921:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893576704 00000100:00100000:2.0:1782727411.183963:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893576704 00000100:00100000:2.0:1782727411.184051:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:2.0:1782727411.184065:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+13:11849:x1869324893576704:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:2.0:1782727411.184103:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727411.184132:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2b1 expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.184180:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a431c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.184221:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a431c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.184235:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a431c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.184386:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b1 expref: 15 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.184410:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a431c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b1 expref: 14 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.184420:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9b300) 00010000:00010000:2.0:1782727411.184423:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782727411.184427:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f21600, rc 0) 00000100:00100000:2.0:1782727411.184516:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+14:11849:x1869324893576704:12345-192.168.204.23@tcp:101:dd.0 Request processed in 453us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727411.184523:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:1.0:1782727411.184961:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:3.0:1782727411.196378:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727411.196655:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893576960 00000100:00100000:2.0:1782727411.196670:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893576960 00000100:00100000:2.0:1782727411.196756:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:2.0:1782727411.196769:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+14:11849:x1869324893576960:12345-192.168.204.23@tcp:36:dd.0 00010000:00010000:2.0:1782727411.196844:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727411.196880:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41486400/0x9832bf6cd8a431ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2aa expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.196909:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9b300) 00010000:00010000:2.0:1782727411.197167:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727411.197400:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.197420:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.197432:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782727411.197488:0:5953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000004:00010000:2.0:1782727411.207104:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002809798f reply state 000000007c15a4de transno 4294967320 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727411.207127:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727411.208692:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:11849:x1869324893576960:12345-192.168.204.23@tcp:36:dd.0 Request processed in 11913us (12320us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1782727411.208704:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00000020:00080000:2.0:1782727411.208711:0:5953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782727411.219420:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727411.219672:0:12329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893577088 00000100:00100000:0.0:1782727411.219688:0:12329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893577088 00000100:00100000:0.0:1782727411.219759:0:12329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:0.0:1782727411.219771:0:12329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:11849:x1869324893577088:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:0.0:1782727411.219794:0:12329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727411.219820:0:12329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941f9834/0x9832bf6cd8a431d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2b8 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782727411.219847:0:12329:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782727411.219879:0:12329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1782727411.219884:0:12329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782727411.219893:0:12329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941f9834/0x9832bf6cd8a431d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b8 expref: 6 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.219912:0:12329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000941f9834/0x9832bf6cd8a431d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b8 expref: 6 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.219954:0:12329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80272c00, rc 0) 00000100:00100000:0.0:1782727411.220015:0:12329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:11849:x1869324893577088:12345-192.168.204.23@tcp:101:dd.0 Request processed in 246us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727411.220022:0:12329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00010000:00010000:1.0:1782727411.220208:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727411.220217:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727411.220223:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727411.220229:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f20c00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727411.220234:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727411.220243:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727411.220256:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9b300) 00010000:00010000:1.0:1782727411.220259:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727411.220263:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727411.220286:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727411.229875:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727411.230441:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893577216 00000100:00100000:0.0:1782727411.230457:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893577216 00000100:00100000:0.0:1782727411.230755:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:0.0:1782727411.230767:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:11849:x1869324893577216:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:0.0:1782727411.230799:0:6941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727411.230822:0:6941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b112bec/0x9832bf6cd8a431d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2bf expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782727411.230848:0:6941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782727411.230872:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1782727411.230876:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782727411.230885:0:6941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b112bec/0x9832bf6cd8a431d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2bf expref: 7 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.230903:0:6941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b112bec/0x9832bf6cd8a431d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2bf expref: 7 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.230915:0:6941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273800, rc 0) 00000100:00100000:0.0:1782727411.231043:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:11849:x1869324893577216:12345-192.168.204.23@tcp:101:dd.0 Request processed in 279us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727411.231051:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:3.0:1782727411.243426:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727411.243573:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727411.244702:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893577344 00000100:00100000:1.0:1782727411.244715:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893577344 00002000:00010000:0.0:1782727411.245023:0:6944:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1782727411.245029:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef70380e00 with x1869324893577344 ext(0->18446744073709551615) 00002000:00010000:0.0:1782727411.245040:0:6944:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef70380e00. 00000100:00100000:0.0:1782727411.245132:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893577472 00000100:00100000:0.0:1782727411.245136:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893577472 00002000:00010000:0.0:1782727411.245152:0:6944:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:0.0:1782727411.245155:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e4a2d80 with x1869324893577472 ext(0->18446744073709551615) 00002000:00010000:0.0:1782727411.245161:0:6944:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cef7e4a2d80. 00000100:00100000:3.0:1782727411.245349:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:3.0:1782727411.245361:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef70380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893577344:12345-192.168.204.23@tcp:10:dd.0 00002000:00010000:3.0:1782727411.245594:0:6946:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782727411.245598:0:6946:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782727410 00002000:00010000:3.0:1782727411.245601:0:6946:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782727411.245603:0:6946:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782727410 00002000:00010000:3.0:1782727411.245605:0:6946:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1782727411.246983:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef70380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2337:x1869324893577344:12345-192.168.204.23@tcp:10:dd.0 Request processed in 1617us (3557us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782727411.246997:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00002000:00010000:3.0:1782727411.247003:0:6946:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1782727411.247007:0:6946:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef70380e00 with x1869324893577344 ext(0->18446744073709551615) 00002000:00010000:3.0:1782727411.247015:0:6946:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef70380e00. 00000100:00100000:3.0:1782727411.247050:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:3.0:1782727411.247063:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2337:x1869324893577472:12345-192.168.204.23@tcp:10:dd.0 00002000:00010000:3.0:1782727411.247699:0:6946:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782727411.247703:0:6946:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782727410 00002000:00010000:3.0:1782727411.247706:0:6946:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782727411.247708:0:6946:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782727410 00002000:00010000:3.0:1782727411.247711:0:6946:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1782727411.248093:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:2337:x1869324893577472:12345-192.168.204.23@tcp:10:dd.0 Request processed in 688us (4172us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782727411.248102:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00002000:00010000:3.0:1782727411.248106:0:6946:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:3.0:1782727411.248110:0:6946:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e4a2d80 with x1869324893577472 ext(0->18446744073709551615) 00002000:00010000:3.0:1782727411.248115:0:6946:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cef7e4a2d80. 00000100:00100000:2.0:1782727411.300843:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727411.300961:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893577728 00000100:00100000:0.0:1782727411.300988:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893577728 00000100:00100000:0.0:1782727411.301060:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:0.0:1782727411.301071:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef80094c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+15:11849:x1869324893577728:12345-192.168.204.23@tcp:35:dd.0 00000100:00100000:0.0:1782727411.301413:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef80094c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:11849:x1869324893577728:12345-192.168.204.23@tcp:35:dd.0 Request processed in 343us (579us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1782727411.301422:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:0.0:1782727411.342205:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727411.342342:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893577856 00000100:00100000:2.0:1782727411.342352:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893577856 00002000:00100000:2.0:1782727411.342422:0:6944:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->131071) req@ffff8cef7e52c000 x1869324893577856/t0(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:282/0 lens 488/0 e 0 to 0 dl 1782727422 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727411.342433:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e52c000 with x1869324893577856 ext(0->131071) 00002000:00010000:2.0:1782727411.342441:0:6944:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e52c000 00000100:00100000:2.0:1782727411.342475:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:2.0:1782727411.342489:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2338:x1869324893577856:12345-192.168.204.23@tcp:4:dd.0 00000100:00100000:2.0:1782727411.355394:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:2338:x1869324893577856:12345-192.168.204.23@tcp:4:dd.0 Request processed in 12892us (13180us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782727411.355431:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00002000:00100000:2.0:1782727411.356657:0:6944:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->131071) req@ffff8cef7e52c000 x1869324893577856/t4294967301(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:282/0 lens 488/448 e 0 to 0 dl 1782727422 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727411.356675:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e52c000 with x1869324893577856 ext(0->131071) 00002000:00010000:2.0:1782727411.356963:0:6944:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e52c000 00000100:00100000:0.0:1782727411.381186:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727411.381400:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893577984 00000100:00100000:2.0:1782727411.381416:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893577984 00000100:00100000:2.0:1782727411.381672:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:2.0:1782727411.381801:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:11851:x1869324893577984:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:2.0:1782727411.381838:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727411.381872:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a431de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2c6 expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.382668:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.383175:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.383192:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727411.383255:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727411.383259:0:9207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727411.383291:0:9207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.383328:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a431de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2c6 expref: 18 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.383373:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2c6 expref: 17 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.383384:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296500) 00010000:00010000:2.0:1782727411.383388:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727411.383392:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f20c00, rc 0) 00000100:00100000:2.0:1782727411.383484:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+17:11851:x1869324893577984:12345-192.168.204.23@tcp:101:rm.0 Request processed in 1689us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727411.383495:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:0.0:1782727411.390982:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727411.391282:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893578112 00000100:00100000:3.0:1782727411.391307:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893578112 00000100:00100000:3.0:1782727411.391691:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:3.0:1782727411.391709:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+17:11851:x1869324893578112:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:3.0:1782727411.391742:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727411.391770:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a431ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2cd expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.391858:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a431f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.391877:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a431f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.391890:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a431f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.391965:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a431fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.391974:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a431fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.391981:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a431fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392083:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a43201 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392094:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a43201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392100:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a43201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727411.392369:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 131072 00000004:00200000:3.0:1782727411.392375:0:5954:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727411.392401:0:5954:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a43201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392415:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a43201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392425:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a431f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392432:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a431f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392452:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a431f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392458:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41524400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727411.392462:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a431f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392470:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a431f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392485:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296500) 00010000:00010000:3.0:1782727411.392488:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727411.392494:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a431f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392499:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a431f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392516:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a431fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392523:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a431fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392529:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a431fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392534:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525e00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727411.392536:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a431fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392551:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a431fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392558:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8cef800dea00) 00010000:00010000:3.0:1782727411.392561:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727411.392563:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a431fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392569:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a431fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392608:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a431ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2cd expref: 19 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392633:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a43201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2cd expref: 18 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.392640:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9b300) 00010000:00010000:3.0:1782727411.392643:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727411.392645:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41524c00, rc 0) 00000100:00100000:3.0:1782727411.392846:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+18:11851:x1869324893578112:12345-192.168.204.23@tcp:101:rm.0 Request processed in 1141us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727411.392855:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:1.0:1782727411.428077:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727411.428386:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893578368 00000100:00100000:0.0:1782727411.428397:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893578368 00000100:00100000:0.0:1782727411.428461:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:0.0:1782727411.428473:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+18:11851:x1869324893578368:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:0.0:1782727411.428541:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1782727411.428571:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a43201 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2cd expref: 18 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428596:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a431c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b1 expref: 17 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428611:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273600/0x9832bf6cd8a43183 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a29c expref: 16 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428633:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9b300) 00010000:00010000:0.0:1782727411.428650:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a431e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2c6 expref: 15 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428676:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296500) 00010000:00010000:0.0:1782727411.428683:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727411.428708:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a43208 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428719:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a43208 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428727:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a43208 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428739:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428747:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428753:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428834:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43216 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428842:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43216 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.428848:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43216 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782727411.429171:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1782727411.429183:0:5951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315605254103ns, next at 316605251569ns, rc = 0 00000040:00080000:0.0:1782727411.429215:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1782727411.429222:0:5951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315605293328ns, next at 316605291816ns, rc = 0 00010000:00010000:0.0:1782727411.429548:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429558:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429565:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429573:0:5951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429579:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429584:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429623:0:5951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727411.429644:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43216 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429650:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43216 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429655:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43216 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429661:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727411.429665:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43216 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429678:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43216 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429688:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9bc00) 00010000:00010000:0.0:1782727411.429691:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782727411.429694:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43216 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429699:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43216 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429720:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a43208 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429727:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a43208 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429733:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a43208 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429738:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80272a00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727411.429740:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a43208 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429744:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a43208 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429749:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9b800) 00010000:00010000:0.0:1782727411.429751:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727411.429754:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a43208 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727411.429768:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a43208 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727411.429781:0:5951:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076b5ac4c reply state 000000001069af2f transno 4294967322 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727411.429790:0:5951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727411.429873:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:11851:x1869324893578368:12345-192.168.204.23@tcp:36:rm.0 Request processed in 1400us (1804us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1782727411.429882:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00010000:00010000:3.0:1782727411.430089:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727411.430098:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.430105:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273e00 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:3.0:1782727411.430116:0:6954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.430131:0:6954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.430141:0:6954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cef77d9bc00) 00010000:00010000:3.0:1782727411.430144:0:6954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782727411.430146:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.430151:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a4321d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.430166:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727411.430168:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727411.430169:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727411.437348:0:3431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.437367:0:3431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.437375:0:3431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.437382:0:3431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80272600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727411.437387:0:3431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.437395:0:3431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.437430:0:3431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8cef77d9bf00) 00010000:00010000:3.0:1782727411.437433:0:3431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727411.437438:0:3431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727411.437445:0:3431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a4320f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727411.439106:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727411.695321:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912486016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727411.695400:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727411.695480:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912486016 00000100:00100000:3.0:1782727411.695494:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912486016 00000100:00100000:3.0:1782727411.695596:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782727411.695618:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912486016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727411.695651:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125952 pending 155648 free 3923668992 avail 3692146688 00000100:00080000:1.0:1782727411.695676:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727411.695748:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912486016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727411.695757:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782727411.695880:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912486016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727412.208149:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912486272:0@lo:400:kworker.0 00000100:00100000:0.0:1782727412.208243:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727412.208316:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912486784:0@lo:400:kworker.0 00000100:00100000:0.0:1782727412.208346:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727412.208378:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727412.208385:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912486400:0@lo:400:kworker.0 00000100:00100000:0.0:1782727412.208409:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727412.208438:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912486272 00000100:00100000:0.0:1782727412.208445:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912486272 00000100:00100000:0.0:1782727412.208489:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912486400 00000100:00100000:0.0:1782727412.208492:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912486400 00000100:00100000:0.0:1782727412.208521:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782727412.208531:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912486272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727412.208635:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782727412.208645:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912486400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727412.208676:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912486144:0@lo:400:kworker.0 00000100:00100000:3.0:1782727412.208719:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727412.208744:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912486656:0@lo:400:kworker.0 00000100:00100000:3.0:1782727412.208765:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727412.208778:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727412.208783:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912486528:0@lo:400:kworker.0 00000100:00100000:3.0:1782727412.208804:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727412.208826:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869324912486400:12345-0@lo:400:kworker.0 Request processed in 181us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727412.208830:0:5954:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782727412.208833:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782727412.208838:0:5954:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1782727412.208851:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912486656 00000100:00100000:3.0:1782727412.208852:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912486784 00000100:00100000:3.0:1782727412.208854:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912486784 00000100:00100000:2.0:1782727412.208854:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912486656 00000100:00100000:3.0:1782727412.208885:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912486528 00000100:00100000:3.0:1782727412.208888:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912486528 00000100:00100000:3.0:1782727412.208907:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782727412.208913:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912486784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727412.208961:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782727412.208968:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912486656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727412.208970:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869324912486784:12345-0@lo:400:kworker.0 Request processed in 58us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727412.208976:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782727412.208988:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782727412.208993:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912486528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727412.208999:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324912486656:12345-0@lo:400:kworker.0 Request processed in 32us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727412.209005:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782727412.209018:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912486528:12345-0@lo:400:kworker.0 Request processed in 25us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727412.209022:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782727412.209042:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3446:1869324912486400:0@lo:400:kworker.0 00000100:00100000:3.0:1782727412.209145:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912486528:0@lo:400:kworker.0 00000100:00100000:3.0:1782727412.209154:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324912486656:0@lo:400:kworker.0 00000100:00080000:1.0:1782727412.209686:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727412.209692:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727412.209713:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912486144 00000100:00100000:1.0:1782727412.209718:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912486144 00000100:00100000:1.0:1782727412.209760:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1782727412.209767:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912486144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727412.209846:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3445:x1869324912486144:12345-0@lo:400:kworker.0 Request processed in 79us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727412.209852:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1782727412.210051:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c805432-a345-4b8b-859c-fa0b2938956c:3445:1869324912486144:0@lo:400:kworker.0 00000100:00100000:2.0:1782727412.211656:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869324912486272:0@lo:400:kworker.0 00000100:00100000:0.0:1782727412.211656:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869324912486272:12345-0@lo:400:kworker.0 Request processed in 3119us (3406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727412.211670:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1782727412.211696:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3446:1869324912486784:0@lo:400:kworker.0 00010000:00010000:2.0:1782727412.463422:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727412.671831:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727412.671870:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893578496 00000100:00100000:2.0:1782727412.671881:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893578496 00000100:00100000:2.0:1782727412.671956:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:2.0:1782727412.671967:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+15:11893:x1869324893578496:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1782727412.671994:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727412.672018:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a43224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2d4 expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727412.672082:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a4322b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727412.672096:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a4322b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727412.672107:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a4322b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727412.672154:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727412.672158:0:9207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727412.672179:0:9207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a4322b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727412.672204:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a43224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2d4 expref: 17 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727412.672218:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a4322b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2d4 expref: 16 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727412.672233:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296a00) 00010000:00010000:2.0:1782727412.672236:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727412.672239:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f20800, rc 0) 00000100:00100000:2.0:1782727412.672293:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:11893:x1869324893578496:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 328us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727412.672300:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:0.0:1782727412.679818:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727412.679904:0:12634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893578752 00000100:00100000:1.0:1782727412.679914:0:12634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893578752 00000100:00100000:1.0:1782727412.680108:0:12634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:1.0:1782727412.680120:0:12634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:11893:x1869324893578752:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1782727412.680142:0:12634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727412.680145:0:12634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782727412.680180:0:12634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a4322b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2d4 expref: 16 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.680198:0:12634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296a00) 00010000:00010000:1.0:1782727412.680209:0:12634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727412.680225:0:12634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a43232 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2db expref: -99 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.680336:0:12634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a43239 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.680350:0:12634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a43239 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.680361:0:12634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a43239 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.680435:0:12634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.680444:0:12634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.680451:0:12634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782727412.680804:0:12634:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1782727412.680947:0:12634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4400/0x9832bf6cd8a43247 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.680957:0:12634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4400/0x9832bf6cd8a43247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.680975:0:12634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4400/0x9832bf6cd8a43247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.681007:0:12634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a43239 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.681014:0:12634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a43239 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.681021:0:12634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a43239 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.681026:0:12634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da4a00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727412.681030:0:12634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a43239 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.681037:0:12634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a43239 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.681045:0:12634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef43e22f00) 00010000:00010000:1.0:1782727412.681048:0:12634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727412.681051:0:12634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a43239 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.681057:0:12634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a43239 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727412.681069:0:12634:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dd9ec1b9 reply state 000000004a8968a7 transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727412.681078:0:12634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782727412.681106:0:12634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a43232 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2db expref: 18 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.681122:0:12634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4400/0x9832bf6cd8a43247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2db expref: 17 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.681130:0:12634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cef43e22900) 00010000:00010000:1.0:1782727412.681132:0:12634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782727412.681134:0:12634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da4400, rc 0) 00000100:00100000:1.0:1782727412.681192:0:12634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c9ff188-fb9c-4b39-a5ed-2408b1373248+18:11893:x1869324893578752:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1075us (1386us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1782727412.681199:0:12634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:3.0:1782727412.690301:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727412.690349:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893578880 00000100:00100000:0.0:1782727412.690360:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893578880 00000100:00100000:0.0:1782727412.690490:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:0.0:1782727412.690512:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:11893:x1869324893578880:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1782727412.690533:0:6938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727412.690556:0:6938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9ed932a/0x9832bf6cd8a43255 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2e2 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782727412.690581:0:6938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782727412.690614:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1782727412.690619:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782727412.690628:0:6938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ed932a/0x9832bf6cd8a43255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e2 expref: 10 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727412.690645:0:6938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9ed932a/0x9832bf6cd8a43255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e2 expref: 10 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727412.690958:0:6938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273400, rc 0) 00010000:00010000:1.0:1782727412.691022:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727412.691028:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:11893:x1869324893578880:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 528us (733us total) trans 0 rc 0/0 00010000:00010000:1.0:1782727412.691032:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727412.691036:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00010000:00010000:1.0:1782727412.691040:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.691046:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da5400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727412.691050:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.691057:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.691071:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11a4e1a9 (ffff8cef43e22400) 00010000:00010000:1.0:1782727412.691075:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727412.691091:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727412.691098:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43240 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727412.696530:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727412.696613:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893579008 00000100:00100000:1.0:1782727412.696623:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893579008 00002000:00100000:1.0:1782727412.696689:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cef7e665180 x1869324893579008/t0(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:283/0 lens 4584/0 e 0 to 0 dl 1782727423 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782727412.696701:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e665180 with x1869324893579008 ext(0->4095) 00002000:00010000:1.0:1782727412.696707:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e665180 00000100:00100000:1.0:1782727412.696739:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:1.0:1782727412.696751:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:2337:x1869324893579008:12345-192.168.204.23@tcp:4:multiop.0 00000001:00020000:1.0:1782727412.696763:0:6945:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 sleeping for 1000ms 00000004:00080000:0.0:1782727412.719180:0:8327:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 316895248727ns, next at 317895246193ns, rc = 0 00000100:00100000:2.0:1782727412.719756:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912486912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727412.719833:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727412.722323:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912486912 00000100:00100000:0.0:1782727412.722337:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912486912 00000100:00100000:0.0:1782727412.722400:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782727412.722411:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912486912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727412.722456:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727412.722537:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912486912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727412.722544:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782727412.722777:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912486912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782727413.487897:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1782727413.752431:0:6945:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 awake 00000100:00100000:1.0:1782727413.770373:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:2337:x1869324893579008:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 1073606us (1073836us total) trans 0 rc -30/-30 00000100:00100000:1.0:1782727413.770392:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00002000:00100000:1.0:1782727413.770418:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cef7e665180 x1869324893579008/t0(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:283/0 lens 4584/224 e 0 to 0 dl 1782727423 ref 1 fl Complete:/600/0 rc -30/-30 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782727413.770430:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e665180 with x1869324893579008 ext(0->4095) 00002000:00010000:1.0:1782727413.770438:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e665180 00010000:00010000:2.0:1782727414.511165:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727414.881375:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727414.881445:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893579136 00000100:00100000:0.0:1782727414.881456:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893579136 00002000:00100000:0.0:1782727414.881537:0:6944:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cef7e4a0700 x1869324893579136/t0(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:285/0 lens 4584/0 e 0 to 0 dl 1782727425 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782727414.881560:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e4a0700 with x1869324893579136 ext(0->4095) 00002000:00010000:0.0:1782727414.881568:0:6944:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e4a0700 00000100:00100000:0.0:1782727414.881600:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:0.0:1782727414.881611:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:2336:x1869324893579136:12345-192.168.204.23@tcp:4:multiop.0 00000001:00020000:0.0:1782727414.881627:0:6944:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 sleeping for 1000ms 00000100:00080000:1.0:1782727414.881863:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:0.0:1782727415.103584:0:6944:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout interrupted 00000100:00100000:0.0:1782727415.111757:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:2336:x1869324893579136:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 230136us (230381us total) trans 0 rc -30/-30 00000100:00100000:0.0:1782727415.111771:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00002000:00100000:0.0:1782727415.111795:0:6944:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cef7e4a0700 x1869324893579136/t0(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:285/0 lens 4584/224 e 0 to 0 dl 1782727425 ref 1 fl Complete:/600/0 rc -30/-30 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782727415.111805:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e4a0700 with x1869324893579136 ext(0->4095) 00002000:00010000:0.0:1782727415.111812:0:6944:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e4a0700 00010000:00010000:2.0:1782727415.535255:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727416.284591:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727416.284708:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893579392 00000100:00100000:0.0:1782727416.284718:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893579392 00000100:00100000:0.0:1782727416.284780:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 248 00000100:00100000:0.0:1782727416.284791:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893579392:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727416.284905:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2336:x1869324893579392:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727416.284913:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 248 00000100:00100000:2.0:1782727416.290811:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727416.290857:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727416.290890:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727416.290984:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893579520 00000100:00100000:0.0:1782727416.290995:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893579520 00000100:00100000:0.0:1782727416.291074:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:0.0:1782727416.291083:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+17:2336:x1869324893579520:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727416.291158:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+17:2336:x1869324893579520:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 76us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727416.291165:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:1.0:1782727416.291512:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893579648 00000100:00100000:1.0:1782727416.291517:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893579648 00000100:00100000:1.0:1782727416.291568:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893579776 00000100:00100000:1.0:1782727416.291572:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893579776 00000100:00100000:1.0:1782727416.291626:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:1.0:1782727416.291633:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:2336:x1869324893579648:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727416.291665:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:2336:x1869324893579648:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 33us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727416.291671:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:1.0:1782727416.291685:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:1.0:1782727416.291691:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:2337:x1869324893579776:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727416.291722:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:2337:x1869324893579776:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 31us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727416.291728:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00080000:2.0:1782727416.292194:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727416.292199:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782727416.292202:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727416.560014:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782727416.818864:0:7262:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320994932935ns, next at 321994929685ns, rc = 0 00000100:00100000:1.0:1782727416.818879:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912487040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727416.818984:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727416.819248:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912487040 00000100:00100000:3.0:1782727416.819257:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912487040 00000100:00100000:3.0:1782727416.819329:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782727416.819339:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912487040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727416.819371:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125952 pending 155648 free 3923537920 avail 3692015616 00000100:00100000:3.0:1782727416.819418:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912487040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727416.819433:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1782727416.819546:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727416.819599:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912487040:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1782727416.826466:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1782727416.826490:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967323 is committed 00000004:00080000:3.0:1782727416.826498:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1782727416.826500:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1782727416.826811:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727416.826812:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727416.826836:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912487168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782727416.826836:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912487296:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1782727416.826894:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1782727416.827590:0:8023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1782727416.827745:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727416.827904:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912487168 00000100:00100000:2.0:1782727416.827912:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912487168 00000100:00100000:2.0:1782727416.828309:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782727416.828330:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912487168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782727416.828372:0:6940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1782727416.828401:0:6940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.828426:0:6940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000941f9834/0x9832bf6cd8a431d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b8 expref: 6 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.828452:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782727416.828457:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782727416.828461:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.828504:0:6940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000941f9834/0x9832bf6cd8a431d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b8 expref: 6 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.828531:0:6940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000941f9834/0x9832bf6cd8a431d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b8 expref: 6 pid: 12329 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727416.828546:0:6940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77fe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6940:1869324912487424:192.168.204.23@tcp:104: 00000100:00100000:2.0:1782727416.828654:0:6940:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7e5a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1782727416.829573:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727416.829695:0:12329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912487296 00000100:00100000:3.0:1782727416.829703:0:12329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912487296 00000100:00100000:3.0:1782727416.829756:0:12329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782727416.829764:0:12329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912487296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782727416.829785:0:12329:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00010000:00010000:3.0:1782727416.829806:0:12329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.829825:0:12329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b112bec/0x9832bf6cd8a431d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2bf expref: 6 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.829833:0:12329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1782727416.829837:0:12329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727416.829841:0:12329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.829869:0:12329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b112bec/0x9832bf6cd8a431d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2bf expref: 6 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.829880:0:12329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b112bec/0x9832bf6cd8a431d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2bf expref: 6 pid: 6941 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727416.829905:0:12329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e4ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12329:1869324912487552:192.168.204.23@tcp:104: 00000100:00100000:3.0:1782727416.830011:0:12329:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7e44ba80 going to sleep for 11 seconds 00000100:00080000:1.0:1782727416.830653:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727416.836684:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727416.836844:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893579904 00000100:00100000:1.0:1782727416.836854:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893579904 00010000:00010000:1.0:1782727416.836899:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000941f9834/0x9832bf6cd8a431d0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b8 expref: 7 pid: 12329 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727416.836998:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:1.0:1782727416.837009:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2337:x1869324893579904:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782727416.837042:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727416.837049:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000941f9834/0x9832bf6cd8a431d0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b8 expref: 7 pid: 12329 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727416.837064:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000941f9834/0x9832bf6cd8a431d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b8 expref: 7 pid: 12329 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727416.837093:0:5938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727416.837098:0:5938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727416.837109:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727416.837119:0:5938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727416.837142:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727416.837206:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2337:x1869324893579904:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 198us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727416.837214:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00010000:00010000:2.0:1782727416.841576:0:6940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941f9834/0x9832bf6cd8a431d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2b8 expref: 6 pid: 12329 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727416.841602:0:6940:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77fe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6940:1869324912487424:192.168.204.23@tcp:104: 00000100:00100000:3.0:1782727416.841725:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727416.841747:0:12329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e4ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12329:1869324912487552:192.168.204.23@tcp:104: 00010000:00010000:0.0:1782727416.841774:0:12329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727416.841808:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727416.841844:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893580032 00000100:00100000:0.0:1782727416.841851:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893580032 00010000:00010000:0.0:1782727416.841887:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b112bec/0x9832bf6cd8a431d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2bf expref: 7 pid: 6941 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727416.841945:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:0.0:1782727416.841956:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef6c964c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2337:x1869324893580032:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727416.841971:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727416.841991:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b112bec/0x9832bf6cd8a431d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2bf expref: 7 pid: 6941 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.842005:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b112bec/0x9832bf6cd8a431d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2bf expref: 7 pid: 6941 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.842031:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b112bec/0x9832bf6cd8a431d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2bf expref: 7 pid: 6941 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.842045:0:6955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727416.842049:0:6955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727416.842055:0:6955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.842063:0:6955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.842095:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727416.842147:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef6c964c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893580032:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 192us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727416.842156:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00010000:00010000:3.0:1782727416.842165:0:12329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.842176:0:12329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.842186:0:12329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.842194:0:12329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.842216:0:12329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727416.842325:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727416.842333:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.842342:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525400 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:0.0:1782727416.842346:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.842361:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.842373:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.842379:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43263 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.842399:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727416.842402:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727416.842403:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727416.842482:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893579264 00000100:00100000:1.0:1782727416.842488:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893579264 00002000:00100000:1.0:1782727416.842534:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cef7e4aad80 x1869324893579264/t0(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:287/0 lens 4584/0 e 0 to 0 dl 1782727427 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782727416.842544:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e4aad80 with x1869324893579264 ext(0->4095) 00002000:00010000:1.0:1782727416.842550:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e4aad80 00000100:00100000:1.0:1782727416.842572:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:1.0:1782727416.842586:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893579264:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:3.0:1782727416.842609:0:12329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912487296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12844us (13037us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782727416.842619:0:12329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1782727416.843368:0:3447:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cef7e666680/2, rc 0, transno 4294967302 00000100:00100000:0.0:1782727416.843378:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912487296:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782727416.847484:0:6940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.847521:0:6940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.847529:0:6940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.847561:0:6940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.847569:0:6940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.847601:0:6940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727416.847711:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727416.847719:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.847727:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f20600 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:0.0:1782727416.847731:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.847741:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.847777:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.847784:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006e5329/0x9832bf6cd8a4325c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727416.847810:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727416.847812:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727416.847814:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727416.848142:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324912487168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19812us (20395us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1782727416.848154:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:1.0:1782727416.849436:0:3444:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cef7e668000/2, rc 0, transno 4294967303 00000100:00100000:1.0:1782727416.849450:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912487168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782727416.850544:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2336:x1869324893579264:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 7953us (8816us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782727416.850559:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00002000:00100000:2.0:1782727416.850574:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cef7e4aad80 x1869324893579264/t4294967302(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:287/0 lens 4584/448 e 0 to 0 dl 1782727427 ref 1 fl Complete:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727416.850585:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e4aad80 with x1869324893579264 ext(0->4095) 00002000:00010000:2.0:1782727416.850591:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e4aad80 00000100:00100000:0.0:1782727416.860387:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727416.860496:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893580160 00000100:00100000:2.0:1782727416.860522:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893580160 00000100:00100000:2.0:1782727416.860592:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:2.0:1782727416.860601:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:11893:x1869324893580160:12345-192.168.204.23@tcp:44:multiop.0 00000100:00100000:2.0:1782727416.860775:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:11893:x1869324893580160:12345-192.168.204.23@tcp:44:multiop.0 Request processed in 175us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727416.860784:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:3.0:1782727416.867530:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727416.867732:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893580288 00000100:00100000:1.0:1782727416.867744:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893580288 00000100:00100000:1.0:1782727416.867811:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:1.0:1782727416.867821:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2336:x1869324893580288:12345-192.168.204.23@tcp:16:multiop.0 00000001:00080000:3.0:1782727416.875605:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1782727416.875624:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1782727416.876624:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2336:x1869324893580288:12345-192.168.204.23@tcp:16:multiop.0 Request processed in 8048us (8356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727416.876638:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:3.0:1782727416.886061:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727416.886915:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893580544 00000100:00100000:0.0:1782727416.886963:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893580544 00000100:00100000:0.0:1782727416.887043:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1782727416.887053:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:11893:x1869324893580544:12345-192.168.204.23@tcp:35:multiop.0 00000001:00080000:0.0:1782727416.887291:0:5956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1782727416.887419:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:11893:x1869324893580544:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 367us (1366us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1782727416.887427:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000020:00080000:0.0:1782727416.887432:0:5956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782727416.998634:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727416.998819:0:12634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893580672 00000100:00100000:1.0:1782727416.998829:0:12634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893580672 00000100:00100000:1.0:1782727416.998947:0:12634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:1.0:1782727416.998958:0:12634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:11948:x1869324893580672:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:1.0:1782727416.998995:0:12634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727416.999020:0:12634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a4326a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2e9 expref: -99 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727416.999087:0:12634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a43271 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727416.999102:0:12634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a43271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727416.999114:0:12634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a43271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727416.999184:0:12634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727416.999188:0:12634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727416.999210:0:12634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a43271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727416.999238:0:12634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4000/0x9832bf6cd8a4326a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e9 expref: 11 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727416.999262:0:12634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a43271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e9 expref: 10 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727416.999272:0:12634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8800) 00010000:00010000:1.0:1782727416.999275:0:12634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727416.999280:0:12634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5600, rc 0) 00000100:00100000:1.0:1782727416.999464:0:12634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:11948:x1869324893580672:12345-192.168.204.23@tcp:101:rm.0 Request processed in 507us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727416.999472:0:12634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:1.0:1782727417.024050:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727417.024158:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893580928 00000100:00100000:2.0:1782727417.024168:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893580928 00000100:00100000:2.0:1782727417.024238:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:2.0:1782727417.024248:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:11948:x1869324893580928:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:2.0:1782727417.024312:0:9207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782727417.024340:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4400/0x9832bf6cd8a43247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2db expref: 10 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024362:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cef43e22900) 00010000:00010000:2.0:1782727417.024378:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a43271 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e9 expref: 9 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024387:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8800) 00010000:00010000:2.0:1782727417.024392:0:9207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727417.024416:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43278 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024428:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43278 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024437:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43278 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024449:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024455:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024461:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024596:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43286 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024605:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024613:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782727417.024848:0:9207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00010000:00010000:2.0:1782727417.024906:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024917:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024925:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.024997:0:9207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025005:0:9207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025012:0:9207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025038:0:9207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782727417.025057:0:9207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025074:0:9207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43286 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025080:0:9207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43286 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025086:0:9207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727417.025091:0:9207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43286 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025098:0:9207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43286 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025108:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cef49296f00) 00010000:00010000:2.0:1782727417.025111:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782727417.025115:0:9207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43286 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025120:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43286 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025138:0:9207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43278 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025145:0:9207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43278 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025151:0:9207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43278 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025155:0:9207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727417.025164:0:9207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43278 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025171:0:9207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43278 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025179:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296100) 00010000:00010000:2.0:1782727417.025181:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727417.025184:0:9207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43278 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.025190:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43278 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727417.025203:0:9207:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000858b38e1 reply state 00000000346ab5ec transno 4294967326 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727417.025211:0:9207:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727417.025295:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:11948:x1869324893580928:12345-192.168.204.23@tcp:36:rm.0 Request processed in 1046us (1252us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1782727417.025304:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 55 00010000:00010000:1.0:1782727417.025475:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727417.025483:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727417.025490:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f20000 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:1.0:1782727417.025493:0:6954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727417.025499:0:6954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727417.025531:0:6954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cef49296f00) 00010000:00010000:1.0:1782727417.025533:0:6954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782727417.025536:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727417.025543:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20000/0x9832bf6cd8a4328d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727417.025556:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727417.025558:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727417.025559:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727417.028051:0:3431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727417.028069:0:3431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727417.028076:0:3431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727417.028097:0:3431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21e00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727417.028102:0:3431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727417.028109:0:3431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727417.028124:0:3431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11a4e1a9 (ffff8cef49296000) 00010000:00010000:0.0:1782727417.028127:0:3431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727417.028131:0:3431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727417.028138:0:3431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a4327f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727417.329979:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912487680:0@lo:400:kworker.0 00000100:00100000:2.0:1782727417.330066:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727417.330211:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912487680 00000100:00100000:1.0:1782727417.330220:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912487680 00000100:00100000:1.0:1782727417.330284:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1782727417.330315:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912487680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727417.330788:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912487680:12345-0@lo:400:kworker.0 Request processed in 493us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727417.330797:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1782727417.330804:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912488064:0@lo:400:kworker.0 00000100:00100000:1.0:1782727417.330838:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912487808:0@lo:400:kworker.0 00000100:00100000:3.0:1782727417.330850:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727417.330874:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727417.330897:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324912487936:0@lo:400:kworker.0 00000100:00100000:3.0:1782727417.330954:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727417.331199:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912487680:0@lo:400:kworker.0 00000100:00100000:1.0:1782727417.331253:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912488064 00000100:00100000:1.0:1782727417.331258:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912488064 00000100:00100000:1.0:1782727417.331322:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912487808 00000100:00100000:1.0:1782727417.331325:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912487808 00000100:00100000:1.0:1782727417.331346:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912487936 00000100:00100000:1.0:1782727417.331349:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912487936 00000100:00100000:1.0:1782727417.331365:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782727417.331372:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912488064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727417.331431:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869324912488064:12345-0@lo:400:kworker.0 Request processed in 59us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727417.331438:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782727417.331452:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782727417.331459:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912487808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727417.331522:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324912487808:12345-0@lo:400:kworker.0 Request processed in 63us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727417.331529:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782727417.331542:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782727417.331548:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324912487936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727417.331583:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324912487936:12345-0@lo:400:kworker.0 Request processed in 35us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727417.331589:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782727417.331618:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324912487808:0@lo:400:kworker.0 00000100:00100000:1.0:1782727417.331674:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3446:1869324912488064:0@lo:400:kworker.0 00000100:00080000:2.0:1782727417.331843:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727417.331874:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324912487936:0@lo:400:kworker.0 00010000:00010000:0.0:1782727417.583212:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727417.840865:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912488192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727417.840968:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727417.841175:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912488192 00000100:00100000:0.0:1782727417.841184:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912488192 00000100:00100000:0.0:1782727417.841241:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782727417.841250:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912488192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727417.841279:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727417.841327:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912488192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727417.841334:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782727417.841527:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912488192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727418.609810:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727419.632127:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727420.655232:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727421.402696:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727421.402751:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727421.402783:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727421.402812:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727421.402884:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893581184 00000100:00100000:3.0:1782727421.402898:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893581184 00000100:00100000:3.0:1782727421.403012:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:3.0:1782727421.403025:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:2337:x1869324893581184:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727421.403133:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:2337:x1869324893581184:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 111us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727421.403142:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:3.0:1782727421.403171:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893581312 00000100:00100000:3.0:1782727421.403174:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893581312 00000100:00100000:3.0:1782727421.403203:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893581440 00000100:00100000:3.0:1782727421.403206:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893581440 00000100:00100000:3.0:1782727421.403230:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:3.0:1782727421.403237:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893581312:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727421.403264:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893581312:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727421.403271:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:3.0:1782727421.403283:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:3.0:1782727421.403289:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893581440:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727421.403397:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893581440:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 107us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727421.403404:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00080000:3.0:1782727421.403446:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727421.403461:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727421.403465:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727421.403721:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893581056 00000100:00100000:0.0:1782727421.403727:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893581056 00000100:00100000:0.0:1782727421.403776:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 250 00000100:00100000:0.0:1782727421.403784:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef703ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893581056:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1782727421.403832:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef703ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2337:x1869324893581056:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 48us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727421.403840:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 250 00010000:00010000:0.0:1782727421.686213:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782727421.936556:0:7262:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326112624238ns, next at 327112620030ns, rc = 0 00000100:00100000:3.0:1782727421.936617:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e1d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912488320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727421.936737:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727421.937287:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912488320 00000100:00100000:0.0:1782727421.937310:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912488320 00000100:00100000:0.0:1782727421.937388:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782727421.937400:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912488320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727421.937452:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 25408064 pending 0 free 3923664896 avail 3692142592 00000100:00100000:0.0:1782727421.937524:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912488320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727421.937534:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1782727421.937806:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727421.937843:0:3444:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1782727421.937851:0:3444:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cef7e668000, transno 4294967303 00000100:00100000:3.0:1782727421.937877:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e1d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912488320:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1782727421.947864:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:0.0:1782727421.948153:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000004:00080000:0.0:1782727421.948168:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1782727421.948817:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727421.948850:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912488448:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782727421.948983:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727421.949078:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912488448 00000100:00100000:2.0:1782727421.949091:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912488448 00000100:00100000:2.0:1782727421.949199:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782727421.949209:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912488448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782727421.949369:0:6940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00010000:00010000:2.0:1782727421.949400:0:6940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727421.949435:0:6940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9ed932a/0x9832bf6cd8a43255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e2 expref: 5 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727421.949445:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1782727421.949450:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782727421.949454:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727421.949486:0:6940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9ed932a/0x9832bf6cd8a43255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e2 expref: 5 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727421.949503:0:6940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9ed932a/0x9832bf6cd8a43255 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e2 expref: 5 pid: 6938 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727421.949520:0:6940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77fe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6940:1869324912488576:192.168.204.23@tcp:104: 00000100:00100000:2.0:1782727421.949618:0:6940:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7e5a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727421.960034:0:6940:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77fe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6940:1869324912488576:192.168.204.23@tcp:104: 00010000:00010000:2.0:1782727421.960079:0:6940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727421.971088:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727421.971153:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893581568 00000100:00100000:3.0:1782727421.971165:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893581568 00010000:00010000:3.0:1782727421.971223:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ed932a/0x9832bf6cd8a43255 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e2 expref: 6 pid: 6938 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727421.971274:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:3.0:1782727421.971286:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893581568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782727421.971302:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727421.971308:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9ed932a/0x9832bf6cd8a43255 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e2 expref: 6 pid: 6938 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971322:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9ed932a/0x9832bf6cd8a43255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e2 expref: 6 pid: 6938 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971365:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9ed932a/0x9832bf6cd8a43255 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2e2 expref: 6 pid: 6938 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971385:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727421.971390:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727421.971395:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971406:0:5936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971448:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727421.971523:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:2337:x1869324893581568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 239us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727421.971531:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00010000:00010000:3.0:1782727421.971617:0:6940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971628:0:6940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971639:0:6940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971646:0:6940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971672:0:6940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782727421.971884:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324912488448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22676us (22913us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782727421.971893:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1782727421.971919:0:6954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727421.971953:0:6954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971962:0:6954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21400 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:3.0:1782727421.971966:0:6954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971975:0:6954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971987:0:6954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.971993:0:6954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d84efcfb/0x9832bf6cd8a43294 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727421.972012:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727421.972013:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727421.972015:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782727421.973348:0:3444:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cef7e66ad80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1782727421.973369:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e66ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912488448:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1782727422.328288:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:0.0:1782727422.447245:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912488832:0@lo:400:kworker.0 00000100:00100000:0.0:1782727422.447319:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727422.447409:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782727422.447416:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e66b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912488704:0@lo:400:kworker.0 00000100:00100000:0.0:1782727422.447446:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727422.447490:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912489216:0@lo:400:kworker.0 00000100:00100000:0.0:1782727422.447534:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727422.447569:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912489216 00000100:00100000:0.0:1782727422.447576:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912489216 00000100:00100000:0.0:1782727422.447632:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782727422.447640:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912489216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727422.447691:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912489216:12345-0@lo:400:kworker.0 Request processed in 52us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727422.447699:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1782727422.447721:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727422.447750:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912489216:0@lo:400:kworker.0 00000100:00100000:1.0:1782727422.447957:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912488832 00000100:00100000:1.0:1782727422.447962:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912488832 00000100:00100000:1.0:1782727422.447992:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782727422.447997:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912488832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727422.448036:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1869324912488832:12345-0@lo:400:kworker.0 Request processed in 38us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727422.448051:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782727422.448071:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912488704 00000100:00100000:1.0:1782727422.448075:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912488704 00000100:00100000:1.0:1782727422.448100:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1782727422.448107:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef4248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912488704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727422.448141:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef4248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912488704:12345-0@lo:400:kworker.0 Request processed in 33us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727422.448147:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1782727422.448182:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e66b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912488704:0@lo:400:kworker.0 00000100:00100000:1.0:1782727422.448191:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3447:1869324912488832:0@lo:400:kworker.0 00000100:00100000:2.0:1782727422.448488:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912488960:0@lo:400:kworker.0 00000100:00100000:2.0:1782727422.448526:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727422.448559:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727422.448565:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e66aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912489088:0@lo:400:kworker.0 00000100:00100000:2.0:1782727422.448589:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727422.448743:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912488960 00000100:00100000:0.0:1782727422.448748:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912488960 00000100:00100000:0.0:1782727422.448794:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912489088 00000100:00100000:0.0:1782727422.448797:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912489088 00000100:00100000:0.0:1782727422.448816:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782727422.448824:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912488960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727422.448863:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324912488960:12345-0@lo:400:kworker.0 Request processed in 41us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727422.448871:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782727422.448884:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782727422.448891:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef77fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912489088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727422.448918:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef77fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324912489088:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727422.448924:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1782727422.449622:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727422.449659:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e66aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324912489088:0@lo:400:kworker.0 00000100:00100000:2.0:1782727422.449671:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324912488960:0@lo:400:kworker.0 00010000:00010000:2.0:1782727422.703384:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727422.960568:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912489344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727422.960638:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727422.960732:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912489344 00000100:00100000:0.0:1782727422.960739:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912489344 00000100:00100000:0.0:1782727422.960783:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782727422.960792:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912489344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727422.960823:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727422.960867:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912489344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727422.960874:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782727422.960923:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912489344:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1782727422.965006:0:8023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:0.0:1782727423.727509:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727424.338495:0:12903:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 118d: Fsync validation inject a delay of the bulk ==================================================================== 06:03:41 (1782727421) 00010000:00010000:3.0:1782727424.751765:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727425.114059:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727425.114291:0:12634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893581696 00000100:00100000:3.0:1782727425.114306:0:12634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893581696 00000100:00100000:3.0:1782727425.114421:0:12634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:3.0:1782727425.114435:0:12634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:12580:x1869324893581696:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1782727425.114465:0:12634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727425.114496:0:12634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a4329b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2f0 expref: -99 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.114590:0:12634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.114610:0:12634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.114628:0:12634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727425.114716:0:12634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727425.114721:0:12634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727425.114748:0:12634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.114782:0:12634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a4329b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f0 expref: 8 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.114807:0:12634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f0 expref: 7 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.114817:0:12634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800ded00) 00010000:00010000:3.0:1782727425.114837:0:12634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727425.114843:0:12634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41525e00, rc 0) 00000100:00100000:3.0:1782727425.114999:0:12634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:12580:x1869324893581696:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 567us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727425.115007:0:12634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00080000:2.0:1782727425.115096:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727425.139998:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727425.140132:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893581952 00000100:00100000:0.0:1782727425.140146:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893581952 00000100:00100000:0.0:1782727425.140234:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:0.0:1782727425.140247:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:12580:x1869324893581952:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1782727425.140278:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727425.140281:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782727425.140316:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f0 expref: 7 pid: 12634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.140355:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800ded00) 00010000:00010000:0.0:1782727425.140371:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727425.140394:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a432a9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2f7 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.140540:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a432b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.140576:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a432b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.140588:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a432b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.140605:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.140611:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.140618:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141225:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141237:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141244:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727425.141256:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:0.0:1782727425.141288:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a432b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141297:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a432b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141303:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a432b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141318:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273e00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727425.141322:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a432b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141330:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a432b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141342:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9bb00) 00010000:00010000:0.0:1782727425.141344:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727425.141359:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a432b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141365:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273e00/0x9832bf6cd8a432b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727425.141378:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d238bb5 reply state 0000000020e4065a transno 4294967327 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727425.141388:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782727425.141419:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272600/0x9832bf6cd8a432a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f7 expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141436:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f7 expref: 8 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.141443:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef77d9be00) 00010000:00010000:0.0:1782727425.141445:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727425.141447:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273800, rc 0) 00000100:00100000:0.0:1782727425.141558:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:12580:x1869324893581952:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1313us (1576us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1782727425.141574:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00010000:00010000:0.0:1782727425.147076:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.147104:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.147114:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.147121:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80272c00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727425.147128:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.147137:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.148371:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8cef77d9ba00) 00010000:00010000:0.0:1782727425.148381:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727425.148390:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.148400:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272c00/0x9832bf6cd8a432b7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727425.154810:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727425.155835:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893582208 00000100:00100000:1.0:1782727425.155852:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893582208 00000100:00100000:1.0:1782727425.156128:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:1.0:1782727425.156294:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:12580:x1869324893582208:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1782727425.156332:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727425.156376:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a432cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a2fe expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.156538:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.156558:0:9207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f7 expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.156568:0:9207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.156640:0:9207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f7 expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.156657:0:9207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f7 expref: 9 pid: 5954 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727425.156673:0:9207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e66bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9207:1869324912489472:192.168.204.23@tcp:104: 00000100:00100000:1.0:1782727425.157067:0:9207:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef781d8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727425.163190:0:9207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e66bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9207:1869324912489472:192.168.204.23@tcp:104: 00010000:00010000:2.0:1782727425.163237:0:9207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727425.163582:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727425.164126:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893582336 00000100:00100000:0.0:1782727425.164138:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893582336 00010000:00010000:1.0:1782727425.166624:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f7 expref: 10 pid: 5954 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727425.166772:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:1.0:1782727425.166785:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:2336:x1869324893582336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782727425.166806:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727425.166814:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f7 expref: 10 pid: 5954 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.166829:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f7 expref: 10 pid: 5954 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.166856:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273800/0x9832bf6cd8a432be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2f7 expref: 10 pid: 5954 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.166879:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef77d9be00) 00010000:00010000:1.0:1782727425.166884:0:5937:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.166915:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.166924:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.167015:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727425.167109:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:2336:x1869324893582336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 326us (3527us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727425.167119:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00010000:00010000:3.0:1782727425.167280:0:9207:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.167289:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727425.167328:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00000004:00080000:3.0:1782727425.167610:0:9207:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00000004:00080000:3.0:1782727425.167618:0:9207:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1782727425.167748:0:9207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.167756:0:9207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.167763:0:9207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.167770:0:9207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da5400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727425.167775:0:9207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.167783:0:9207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.167802:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef77d9be00) 00010000:00010000:3.0:1782727425.167805:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782727425.167809:0:9207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.167815:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a432d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.167881:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a432cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2fe expref: 9 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.167891:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8400) 00010000:00010000:3.0:1782727425.167894:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782727425.167898:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a432cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a2fe expref: 9 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.167909:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da5e00, rc 0) 00000100:00100000:3.0:1782727425.167999:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:12580:x1869324893582208:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 11859us (13206us total) trans 4294967328 rc 301/301 00000100:00100000:3.0:1782727425.168008:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:1.0:1782727425.189095:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727425.189203:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893582592 00000100:00100000:3.0:1782727425.189215:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893582592 00000100:00100000:3.0:1782727425.189293:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:3.0:1782727425.189305:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:12580:x1869324893582592:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1782727425.191691:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:12580:x1869324893582592:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 2372us (2595us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1782727425.191708:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:0.0:1782727425.195981:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727425.196382:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893582720 00000100:00100000:2.0:1782727425.196396:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893582720 00000100:00100000:2.0:1782727425.196497:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:2.0:1782727425.196512:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:12580:x1869324893582720:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1782727425.196549:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727425.196581:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a432e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a305 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.196696:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a432e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a305 expref: 10 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.196715:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a432e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a305 expref: 10 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.196740:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef49296000) 00010000:00010000:2.0:1782727425.196744:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782727425.196748:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f21c00, rc 0) 00000100:00100000:2.0:1782727425.196842:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:12580:x1869324893582720:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 333us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727425.196850:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:1.0:1782727425.204715:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727425.205101:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893582976 00000100:00100000:3.0:1782727425.205115:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893582976 00000100:00100000:3.0:1782727425.205247:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:3.0:1782727425.205259:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:12580:x1869324893582976:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1782727425.205607:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+11:12580:x1869324893582976:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 350us (908us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1782727425.205617:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:1.0:1782727425.240234:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727425.240356:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893583104 00000100:00100000:3.0:1782727425.240369:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893583104 00000100:00100000:3.0:1782727425.240450:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:3.0:1782727425.240462:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+11:12581:x1869324893583104:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:3.0:1782727425.240492:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727425.240546:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a432e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a30c expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.240972:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a432ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.240991:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a432ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.241004:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a432ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727425.241061:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727425.241064:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727425.241088:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a432ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.241116:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a432e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a30c expref: 13 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.241161:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a432ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a30c expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.241171:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800de300) 00010000:00010000:3.0:1782727425.241174:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727425.241178:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41525600, rc 0) 00000100:00100000:3.0:1782727425.241773:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+12:12581:x1869324893583104:12345-192.168.204.23@tcp:101:dd.0 Request processed in 1309us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727425.241784:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:1.0:1782727425.250175:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727425.250246:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893583360 00000100:00100000:3.0:1782727425.250260:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893583360 00000100:00100000:3.0:1782727425.250361:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:3.0:1782727425.250375:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+12:12581:x1869324893583360:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:3.0:1782727425.250413:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727425.250417:0:9207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782727425.250450:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a432ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a30c expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.250477:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800de300) 00010000:00010000:3.0:1782727425.250490:0:9207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727425.250511:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a432f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a313 expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.250760:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.250799:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.250810:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.250826:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a43304 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.250833:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a43304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.250840:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a43304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.250912:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a4330b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.250921:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a4330b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251039:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a4330b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727425.251051:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:3.0:1782727425.251156:0:9207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251164:0:9207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251171:0:9207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251184:0:9207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525e00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727425.251190:0:9207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251197:0:9207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251207:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800de200) 00010000:00010000:3.0:1782727425.251210:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727425.251214:0:9207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251219:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a432fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251231:0:9207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a43304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251236:0:9207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a43304 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251241:0:9207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a43304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251246:0:9207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727425.251249:0:9207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a43304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251254:0:9207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a43304 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251271:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8cef800de100) 00010000:00010000:3.0:1782727425.251273:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727425.251276:0:9207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a43304 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251282:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525400/0x9832bf6cd8a43304 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251329:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524400/0x9832bf6cd8a432f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a313 expref: 14 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251357:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a4330b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a313 expref: 13 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.251365:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef49296000) 00010000:00010000:3.0:1782727425.251368:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727425.251371:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41524c00, rc 0) 00000100:00100000:3.0:1782727425.251463:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+13:12581:x1869324893583360:12345-192.168.204.23@tcp:101:dd.0 Request processed in 1091us (1302us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1782727425.251473:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:1.0:1782727425.258650:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727425.259839:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893583488 00000100:00100000:2.0:1782727425.259858:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893583488 00000100:00100000:2.0:1782727425.260001:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:2.0:1782727425.260016:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+13:12581:x1869324893583488:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:2.0:1782727425.260055:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727425.260089:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a43319 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a31a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.260148:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.260169:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.260185:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.264556:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a43319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a31a expref: 15 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.264595:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a31a expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.264606:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef49296000) 00010000:00010000:2.0:1782727425.264609:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782727425.264614:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f20600, rc 0) 00000100:00100000:2.0:1782727425.264701:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+14:12581:x1869324893583488:12345-192.168.204.23@tcp:101:dd.0 Request processed in 4685us (6062us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727425.264712:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:0.0:1782727425.273495:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727425.273641:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893583744 00000100:00100000:2.0:1782727425.273654:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893583744 00000100:00100000:2.0:1782727425.273732:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:2.0:1782727425.273745:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+14:12581:x1869324893583744:12345-192.168.204.23@tcp:36:dd.0 00010000:00010000:2.0:1782727425.273825:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727425.273863:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41524c00/0x9832bf6cd8a4330b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a313 expref: 14 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.273889:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef49296000) 00010000:00010000:2.0:1782727425.273895:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727425.274190:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.274210:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.274239:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782727425.274293:0:5951:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967332 00000004:00010000:2.0:1782727425.274318:0:5951:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c84ecc8 reply state 000000008d62f1b3 transno 4294967333 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727425.274328:0:5951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727425.274469:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:12581:x1869324893583744:12345-192.168.204.23@tcp:36:dd.0 Request processed in 725us (988us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1782727425.274478:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00000020:00080000:2.0:1782727425.274485:0:5951:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782727425.276970:0:3431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.277200:0:3431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.277212:0:3431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.277244:0:3431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21e00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1782727425.277250:0:3431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.277258:0:3431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.277280:0:3431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef49296000) 00010000:00010000:3.0:1782727425.277283:0:3431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727425.277288:0:3431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.277295:0:3431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21e00/0x9832bf6cd8a43327 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727425.287701:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727425.288121:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893583872 00000100:00100000:3.0:1782727425.288136:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893583872 00000100:00100000:3.0:1782727425.288265:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:3.0:1782727425.288278:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+5:12581:x1869324893583872:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:3.0:1782727425.288303:0:6941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727425.288333:0:6941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d26ca71/0x9832bf6cd8a4332e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a321 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782727425.288377:0:6941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782727425.288419:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1782727425.288425:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782727425.288435:0:6941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d26ca71/0x9832bf6cd8a4332e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a321 expref: 6 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.288475:0:6941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d26ca71/0x9832bf6cd8a4332e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a321 expref: 6 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.288492:0:6941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41524400, rc 0) 00000100:00100000:3.0:1782727425.288586:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:12581:x1869324893583872:12345-192.168.204.23@tcp:101:dd.0 Request processed in 312us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727425.288594:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00080000:2.0:1782727425.295652:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727425.299871:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727425.304228:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893584000 00000100:00100000:3.0:1782727425.304252:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893584000 00000100:00080000:2.0:1782727425.307195:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727425.308659:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:3.0:1782727425.308696:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:12581:x1869324893584000:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:3.0:1782727425.308823:0:6938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727425.308855:0:6938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43335 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a328 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782727425.309018:0:6938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782727425.309053:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1782727425.309059:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782727425.309070:0:6938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a328 expref: 7 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.309094:0:6938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a328 expref: 7 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.309140:0:6938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41525400, rc 0) 00000100:00100000:3.0:1782727425.309248:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:12581:x1869324893584000:12345-192.168.204.23@tcp:101:dd.0 Request processed in 573us (9394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727425.309256:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:1.0:1782727425.316739:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727425.316790:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727425.316889:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893584128 00000100:00100000:2.0:1782727425.316902:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893584128 00002000:00010000:2.0:1782727425.317011:0:6945:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1782727425.317017:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e668000 with x1869324893584128 ext(0->18446744073709551615) 00002000:00010000:2.0:1782727425.317033:0:6945:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e668000. 00000100:00100000:2.0:1782727425.317062:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893584256 00000100:00100000:2.0:1782727425.317065:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893584256 00002000:00010000:2.0:1782727425.317080:0:6945:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1782727425.317083:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e669500 with x1869324893584256 ext(0->18446744073709551615) 00002000:00010000:2.0:1782727425.317089:0:6945:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cef7e669500. 00000100:00100000:2.0:1782727425.317103:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1782727425.317112:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+6:2337:x1869324893584128:12345-192.168.204.23@tcp:10:dd.0 00002000:00010000:2.0:1782727425.317354:0:6945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782727425.317358:0:6945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782727424 00002000:00010000:2.0:1782727425.317378:0:6945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782727425.317381:0:6945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782727424 00002000:00010000:2.0:1782727425.317383:0:6945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782727425.317481:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2337:x1869324893584128:12345-192.168.204.23@tcp:10:dd.0 Request processed in 368us (759us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782727425.317489:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00002000:00010000:2.0:1782727425.317494:0:6945:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1782727425.317496:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e668000 with x1869324893584128 ext(0->18446744073709551615) 00002000:00010000:2.0:1782727425.317501:0:6945:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e668000. 00000100:00100000:2.0:1782727425.317520:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:2.0:1782727425.317527:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2336:x1869324893584256:12345-192.168.204.23@tcp:10:dd.0 00002000:00010000:2.0:1782727425.317625:0:6945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782727425.317628:0:6945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782727424 00002000:00010000:2.0:1782727425.317631:0:6945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782727425.317632:0:6945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782727424 00002000:00010000:2.0:1782727425.317634:0:6945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782727425.317656:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:2336:x1869324893584256:12345-192.168.204.23@tcp:10:dd.0 Request processed in 130us (865us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1782727425.317663:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00002000:00010000:2.0:1782727425.317665:0:6945:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1782727425.317668:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e669500 with x1869324893584256 ext(0->18446744073709551615) 00002000:00010000:2.0:1782727425.317672:0:6945:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cef7e669500. 00000100:00100000:1.0:1782727425.343562:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727425.343665:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893584512 00000100:00100000:0.0:1782727425.343680:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893584512 00000100:00100000:0.0:1782727425.343754:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1782727425.343765:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+15:12581:x1869324893584512:12345-192.168.204.23@tcp:35:dd.0 00000100:00100000:0.0:1782727425.344270:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:12581:x1869324893584512:12345-192.168.204.23@tcp:35:dd.0 Request processed in 504us (721us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1782727425.344278:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:3.0:1782727425.377742:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727425.377881:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893584640 00000100:00100000:2.0:1782727425.377895:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893584640 00002000:00100000:2.0:1782727425.378028:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->131071) req@ffff8cef7e063800 x1869324893584640/t0(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1782727436 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727425.378070:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e063800 with x1869324893584640 ext(0->131071) 00002000:00010000:2.0:1782727425.378079:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e063800 00000100:00100000:2.0:1782727425.378130:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:2.0:1782727425.378141:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2337:x1869324893584640:12345-192.168.204.23@tcp:4:dd.0 00000100:00100000:2.0:1782727425.395037:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:2337:x1869324893584640:12345-192.168.204.23@tcp:4:dd.0 Request processed in 16885us (17300us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782727425.395055:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00002000:00100000:2.0:1782727425.395068:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->131071) req@ffff8cef7e063800 x1869324893584640/t4294967306(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:296/0 lens 488/448 e 0 to 0 dl 1782727436 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727425.395592:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e063800 with x1869324893584640 ext(0->131071) 00002000:00010000:2.0:1782727425.395600:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e063800 00000100:00100000:3.0:1782727425.426070:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727425.426269:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893584768 00000100:00100000:2.0:1782727425.426282:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893584768 00000100:00100000:2.0:1782727425.426385:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:2.0:1782727425.426398:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:12583:x1869324893584768:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:2.0:1782727425.426441:0:9207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727425.426469:0:9207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a4333c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a32f expref: -99 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.426557:0:9207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43343 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.426573:0:9207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43343 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.426621:0:9207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43343 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727425.426685:0:9207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727425.426689:0:9207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727425.426712:0:9207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43343 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.426741:0:9207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a4333c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a32f expref: 18 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.426764:0:9207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43343 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a32f expref: 17 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.426773:0:9207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296f00) 00010000:00010000:2.0:1782727425.426775:0:9207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727425.426780:0:9207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f21200, rc 0) 00000100:00100000:2.0:1782727425.429268:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+17:12583:x1869324893584768:12345-192.168.204.23@tcp:101:rm.0 Request processed in 2856us (3195us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727425.429285:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:0.0:1782727425.441003:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727425.445349:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893584896 00000100:00100000:2.0:1782727425.445371:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893584896 00000100:00100000:2.0:1782727425.445495:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:2.0:1782727425.445507:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+17:12583:x1869324893584896:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:2.0:1782727425.445537:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727425.445563:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a4334a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a336 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.445691:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43351 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.445709:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.445722:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.445739:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a43358 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.445746:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a43358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.445752:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a43358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.445880:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a4335f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.445889:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a4335f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.445896:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a4335f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727425.445979:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 131072 00000004:00200000:2.0:1782727425.445985:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727425.446013:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a4335f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446041:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a4335f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446052:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446060:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43351 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446068:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43351 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446075:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727425.446081:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43351 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446091:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43351 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446105:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296f00) 00010000:00010000:2.0:1782727425.446109:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727425.446114:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446120:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21400/0x9832bf6cd8a43351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446136:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a43358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446142:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a43358 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446154:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a43358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446160:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77f21600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1782727425.446163:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a43358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446170:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a43358 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446178:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8cef49296300) 00010000:00010000:2.0:1782727425.446180:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727425.446183:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a43358 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446189:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21600/0x9832bf6cd8a43358 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446223:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20800/0x9832bf6cd8a4334a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a336 expref: 19 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446241:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a4335f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a336 expref: 18 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.446250:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef49296000) 00010000:00010000:2.0:1782727425.446252:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727425.446254:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77f20c00, rc 0) 00000100:00100000:2.0:1782727425.446362:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+18:12583:x1869324893584896:12345-192.168.204.23@tcp:101:rm.0 Request processed in 856us (5374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727425.446380:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:1.0:1782727425.462539:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727425.462748:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893585152 00000100:00100000:0.0:1782727425.462762:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893585152 00000100:00100000:0.0:1782727425.462854:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00100000:0.0:1782727425.462868:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+18:12583:x1869324893585152:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:0.0:1782727425.463011:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1782727425.463047:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20c00/0x9832bf6cd8a4335f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a336 expref: 18 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463075:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f20600/0x9832bf6cd8a43320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a31a expref: 17 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463090:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21c00/0x9832bf6cd8a432e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a305 expref: 16 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463103:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef49296000) 00010000:00010000:0.0:1782727425.463124:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77f21200/0x9832bf6cd8a43343 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a32f expref: 15 pid: 9207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463160:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef49296f00) 00010000:00010000:0.0:1782727425.463168:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727425.463202:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a43366 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463217:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a43366 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463230:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a43366 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463244:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463251:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463258:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463388:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43374 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463397:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.463404:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782727425.466037:0:5954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1782727425.466055:0:5954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329642126142ns, next at 330642122185ns, rc = 0 00000040:00080000:1.0:1782727425.466081:0:5954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1782727425.466087:0:5954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329642158298ns, next at 330642157287ns, rc = 0 00010000:00010000:1.0:1782727425.466179:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466199:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466233:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466243:0:5954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466250:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466256:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466285:0:5954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782727425.466313:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466320:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43374 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466327:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43374 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466334:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727425.466350:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43374 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466359:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43374 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466396:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef77d9b100) 00010000:00010000:1.0:1782727425.466401:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782727425.466412:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43374 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466419:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273200/0x9832bf6cd8a43374 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466443:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a43366 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466449:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a43366 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466455:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a43366 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466460:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727425.466463:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a43366 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466469:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a43366 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466477:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef77d9ba00) 00010000:00010000:1.0:1782727425.466479:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727425.466482:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a43366 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.466488:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80273400/0x9832bf6cd8a43366 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727425.466506:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ca71bea reply state 00000000667a612b transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727425.466529:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782727425.468025:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727425.468044:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.468093:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da5600 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:0.0:1782727425.468098:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.468106:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.468125:0:5939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8cef77d9b100) 00010000:00010000:0.0:1782727425.468128:0:5939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782727425.468132:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.468138:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5600/0x9832bf6cd8a4337b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.468169:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727425.468171:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727425.468173:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727425.468779:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:12583:x1869324893585152:12345-192.168.204.23@tcp:36:rm.0 Request processed in 5902us (6244us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1782727425.468793:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 66 00010000:00010000:0.0:1782727425.473887:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.473912:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.473922:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.474052:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80272a00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1782727425.474058:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.474091:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.474114:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8cef77d9bb00) 00010000:00010000:0.0:1782727425.474118:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727425.474124:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.474131:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef80272a00/0x9832bf6cd8a4336d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.781196:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727426.527397:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727426.527439:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727426.527478:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727426.527522:0:9207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893585408 00000100:00100000:1.0:1782727426.527533:0:9207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893585408 00000100:00100000:1.0:1782727426.527613:0:9207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 127 00000100:00100000:1.0:1782727426.527626:0:9207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+15:2338:x1869324893585408:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1782727426.527633:0:5945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893585280 00000100:00100000:3.0:1782727426.527640:0:5945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893585280 00000100:00100000:3.0:1782727426.527678:0:5945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 252 00000100:00100000:3.0:1782727426.527700:0:5945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2339:x1869324893585280:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727426.527734:0:9207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+15:2338:x1869324893585408:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727426.527740:0:5945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9ae6c4-246d-4c75-8ed7-b646e1d8d4c2+10:2339:x1869324893585280:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 52us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727426.527749:0:9207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 127 00000100:00100000:3.0:1782727426.527752:0:5945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 252 00000100:00100000:3.0:1782727426.528886:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1782727426.529122:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893585536 00000100:00100000:2.0:1782727426.529131:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893585536 00000100:00100000:1.0:1782727426.529133:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893585664 00000100:00100000:1.0:1782727426.529139:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893585664 00000100:00100000:1.0:1782727426.529196:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:1.0:1782727426.529207:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:2338:x1869324893585664:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727426.529281:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:2338:x1869324893585664:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 77us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727426.529299:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:1.0:1782727426.529317:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:1.0:1782727426.529333:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:2339:x1869324893585536:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1782727426.529360:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:2339:x1869324893585536:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727426.529546:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00010000:00010000:3.0:1782727426.799104:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727426.895475:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727426.895832:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893585792 00000100:00100000:3.0:1782727426.895846:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893585792 00000100:00100000:3.0:1782727426.895998:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:3.0:1782727426.896013:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+15:12625:x1869324893585792:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1782727426.896043:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727426.896077:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a43382 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a33d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727426.896170:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a43389 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727426.896194:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a43389 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727426.896211:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a43389 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727426.896275:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727426.896280:0:5951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727426.896309:0:5951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a43389 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727426.896494:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525e00/0x9832bf6cd8a43382 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a33d expref: 17 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727426.897284:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a43389 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a33d expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727426.897299:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800de800) 00010000:00010000:3.0:1782727426.897302:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727426.897306:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef41525600, rc 0) 00000100:00100000:3.0:1782727426.897411:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:12625:x1869324893585792:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1401us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727426.897421:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:3.0:1782727426.902033:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1782727426.903361:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893586048 00000100:00100000:1.0:1782727426.903378:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893586048 00000100:00100000:1.0:1782727426.903456:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:1.0:1782727426.903468:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+16:12625:x1869324893586048:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1782727426.903496:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727426.903510:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782727426.903547:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef41525600/0x9832bf6cd8a43389 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a33d expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.904732:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef800de800) 00010000:00010000:1.0:1782727426.904748:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727426.904846:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a43390 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a344 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.905024:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43397 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.905041:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43397 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.905054:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43397 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.905068:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.905075:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.905091:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782727426.906245:0:5954:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1782727426.906469:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a433a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906485:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a433a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906494:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a433a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906549:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43397 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906701:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43397 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906709:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43397 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906717:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da5400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727426.906722:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43397 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906731:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43397 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906744:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cef51af8a00) 00010000:00010000:1.0:1782727426.906747:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727426.906758:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43397 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906764:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5400/0x9832bf6cd8a43397 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727426.906776:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001518230c reply state 00000000395e15ed transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727426.906786:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782727426.906829:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da5e00/0x9832bf6cd8a43390 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a344 expref: 18 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906850:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4800/0x9832bf6cd8a433a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a344 expref: 17 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.906857:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cef51af8b00) 00010000:00010000:1.0:1782727426.906860:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782727426.906862:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef77da4800, rc 0) 00000100:00100000:1.0:1782727426.906981:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+18:12625:x1869324893586048:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3514us (4961us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1782727426.906991:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 68 00010000:00010000:1.0:1782727426.911924:0:3431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.911958:0:3431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.911966:0:3431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.911982:0:3431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef77da4a00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1782727426.911987:0:3431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.911995:0:3431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.912017:0:3431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e182d30 (ffff8cef51af8600) 00010000:00010000:1.0:1782727426.912020:0:3431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727426.912025:0:3431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727426.912031:0:3431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cef77da4a00/0x9832bf6cd8a4339e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727426.915697:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727426.915810:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893586176 00000100:00100000:0.0:1782727426.915825:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893586176 00000100:00100000:0.0:1782727426.915956:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:0.0:1782727426.915969:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+9:12625:x1869324893586176:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1782727426.915995:0:6940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727426.916023:0:6940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be874a97/0x9832bf6cd8a433b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd0dce70fe377a34b expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782727426.916056:0:6940:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782727426.916083:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1782727426.916088:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782727426.916098:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be874a97/0x9832bf6cd8a433b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a34b expref: 10 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727426.916120:0:6940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be874a97/0x9832bf6cd8a433b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a34b expref: 10 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727426.916149:0:6940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cef80273e00, rc 0) 00000100:00100000:0.0:1782727426.916247:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:12625:x1869324893586176:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 263us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727426.916256:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:1.0:1782727426.920762:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727426.921102:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893586304 00000100:00100000:0.0:1782727426.921115:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893586304 00002000:00100000:0.0:1782727426.921180:0:6946:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cef7e762300 x1869324893586304/t0(0) o4->4c9ff188-fb9c-4b39-a5ed-2408b1373248@192.168.204.23@tcp:297/0 lens 4584/0 e 0 to 0 dl 1782727437 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782727426.921193:0:6946:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cef7e762300 with x1869324893586304 ext(0->4095) 00002000:00010000:0.0:1782727426.921200:0:6946:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cef7e762300 00000100:00100000:0.0:1782727426.921657:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1782727426.921672:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:2336:x1869324893586304:12345-192.168.204.23@tcp:4:multiop.0 00000001:00020000:0.0:1782727426.921692:0:6946:0:(tgt_handler.c:2784:tgt_brw_write()) cfs_fail_timeout id 214 sleeping for 5000ms 00000004:00080000:3.0:1782727427.057042:0:7262:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331233110605ns, next at 332233106875ns, rc = 0 00000100:00100000:3.0:1782727427.057089:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727427.057121:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912489600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727427.057224:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727427.058301:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912489600 00000100:00100000:0.0:1782727427.058326:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912489600 00000100:00100000:0.0:1782727427.058408:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782727427.058422:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912489600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727427.058470:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33845824 pending 155648 free 3923537920 avail 3692015616 00000100:00100000:0.0:1782727427.060070:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324912489600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1637us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727427.060088:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1782727427.060135:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727427.061085:0:3445:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1782727427.061095:0:3445:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cef7e66ad80, transno 4294967304 00000100:00100000:1.0:1782727427.061125:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3445:1869324912489600:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1782727427.066504:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:0.0:1782727427.066538:0:5930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000004:00080000:0.0:1782727427.066676:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1782727427.066688:0:5930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:0.0:1782727427.066826:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727427.066851:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912489728:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782727427.066959:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727427.067057:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727427.067067:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912489856:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782727427.067094:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727427.067322:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912489728 00000100:00100000:3.0:1782727427.067333:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912489728 00000100:00080000:0.0:1782727427.067792:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727427.069077:0:6938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912489856 00000100:00100000:3.0:1782727427.069097:0:6938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912489856 00000100:00100000:3.0:1782727427.069140:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782727427.069151:0:6938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324912489728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782727427.069195:0:6938:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1782727427.069227:0:6938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.069255:0:6938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a328 expref: 7 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.069266:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782727427.069272:0:6938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727427.069276:0:6938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.069333:0:6938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a328 expref: 7 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.069352:0:6938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a328 expref: 7 pid: 6938 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727427.069479:0:12329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727427.069491:0:12329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e63a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1869324912489856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782727427.069508:0:12329:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1782727427.069526:0:12329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727427.069539:0:12329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d26ca71/0x9832bf6cd8a4332e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a321 expref: 10 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727427.069546:0:12329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782727427.069548:0:12329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727427.069729:0:12329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727427.069756:0:12329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d26ca71/0x9832bf6cd8a4332e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a321 expref: 10 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727427.069767:0:12329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d26ca71/0x9832bf6cd8a4332e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a321 expref: 10 pid: 6941 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727427.069793:0:12329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e639180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12329:1869324912490112:192.168.204.23@tcp:104: 00000100:00100000:0.0:1782727427.069948:0:12329:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef45001000 going to sleep for 11 seconds 00000100:00100000:3.0:1782727427.070015:0:6938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e55bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6938:1869324912489984:192.168.204.23@tcp:104: 00000100:00100000:3.0:1782727427.070045:0:6938:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cef7e44bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727427.079903:0:12329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e639180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12329:1869324912490112:192.168.204.23@tcp:104: 00010000:00010000:1.0:1782727427.080012:0:12329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727427.080176:0:6938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e55bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6938:1869324912489984:192.168.204.23@tcp:104: 00010000:00010000:3.0:1782727427.080209:0:6938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727427.082025:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1782727427.082150:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893586560 00000100:00100000:3.0:1782727427.082162:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893586560 00010000:00010000:3.0:1782727427.082234:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a328 expref: 8 pid: 6938 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727427.082285:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:3.0:1782727427.082297:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+8:2339:x1869324893586560:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782727427.082329:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727427.082337:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a328 expref: 8 pid: 6938 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.082352:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a328 expref: 8 pid: 6938 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.082396:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076386f6e/0x9832bf6cd8a43335 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a328 expref: 8 pid: 6938 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.082415:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727427.082420:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727427.082427:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.082437:0:5936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.082480:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727427.082551:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c9ff188-fb9c-4b39-a5ed-2408b1373248+7:2339:x1869324893586560:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 255us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727427.082560:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00010000:00010000:3.0:1782727427.082669:0:6938:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.082680:0:6938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.082691:0:6938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.082700:0:6938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.082720:0:6938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782727427.082964:0:6938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324912489728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13814us (16004us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782727427.082973:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1782727427.082995:0:5939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727427.083003:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.083012:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef41525e00 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:3.0:1782727427.083025:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.083036:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.083050:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.083059:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000377e4976/0x9832bf6cd8a433ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727427.083079:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727427.083081:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727427.083103:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727427.083161:0:3444:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1782727427.083169:0:3444:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cef7e666680, transno 4294967302 00000100:00100000:3.0:1782727427.083189:0:3444:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8cef7e639880 x1869324912489728/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782727443 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1782727427.083211:0:3444:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cef7e639880/2, rc 0, transno 4294967304 00000100:00100000:3.0:1782727427.083224:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3444:1869324912489728:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1782727427.083477:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727427.092054:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1782727427.092353:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324893586432 00000100:00100000:0.0:1782727427.092462:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324893586432 00010000:00010000:0.0:1782727427.092708:0:6955:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d26ca71/0x9832bf6cd8a4332e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a321 expref: 11 pid: 6941 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782727427.092762:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727427.092834:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:0.0:1782727427.092847:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e763100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+11:2337:x1869324893586432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727427.092923:0:6955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727427.092959:0:6955:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d26ca71/0x9832bf6cd8a4332e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a321 expref: 11 pid: 6941 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727427.092981:0:6955:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d26ca71/0x9832bf6cd8a4332e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a321 expref: 11 pid: 6941 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727427.093017:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d26ca71/0x9832bf6cd8a4332e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.23@tcp remote: 0xd0dce70fe377a321 expref: 11 pid: 6941 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727427.093045:0:6955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727427.093051:0:6955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727427.093057:0:6955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727427.093108:0:6955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727427.093162:0:6955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727427.093336:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e763100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c9ff188-fb9c-4b39-a5ed-2408b1373248+10:2337:x1869324893586432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 490us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727427.093345:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00010000:00010000:2.0:1782727427.093348:0:12329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727427.093357:0:12329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727427.093368:0:12329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727427.093377:0:12329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727427.093398:0:12329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782727427.093660:0:12329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e63a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912489856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24170us (26563us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782727427.093668:0:12329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1782727427.093704:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727427.093712:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727427.093720:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cef80273800 already unused, calling callback (ffffffffc0e6acf0) 00010000:00010000:2.0:1782727427.093725:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727427.093748:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727427.093765:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727427.093772:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b112bec/0x9832bf6cd8a433c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727427.093794:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727427.093796:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727427.093798:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782727427.093828:0:3447:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cef7e638e00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1782727427.093845:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912489856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782727427.571768:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e63b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912490240:0@lo:400:kworker.0 00000100:00100000:1.0:1782727427.571882:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727427.572108:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324912490496:0@lo:400:kworker.0 00000100:00100000:0.0:1782727427.572159:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727427.572235:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727427.572242:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912490368:0@lo:400:kworker.0 00000100:00100000:0.0:1782727427.572266:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727427.572312:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912490496 00000100:00100000:0.0:1782727427.572322:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912490496 00000100:00100000:0.0:1782727427.572396:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912490368 00000100:00100000:0.0:1782727427.572399:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912490368 00000100:00100000:0.0:1782727427.572434:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782727427.572444:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324912490496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727427.572510:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324912490496:12345-0@lo:400:kworker.0 Request processed in 67us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727427.572520:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782727427.572537:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782727427.572543:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e63b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912490368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727427.572567:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e63b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324912490368:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727427.572592:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782727427.572635:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324912490368:0@lo:400:kworker.0 00000100:00100000:0.0:1782727427.572644:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324912490496:0@lo:400:kworker.0 00000100:00100000:1.0:1782727427.572960:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727427.572968:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef7e638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3447:1869324912490624:0@lo:400:kworker.0 00000100:00100000:1.0:1782727427.572998:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727427.573037:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912490624 00000100:00100000:1.0:1782727427.573042:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912490624 00000100:00100000:1.0:1782727427.573082:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782727427.573088:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1869324912490624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727427.573452:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1869324912490624:12345-0@lo:400:kworker.0 Request processed in 362us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727427.573461:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782727427.573503:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3447:1869324912490624:0@lo:400:kworker.0 00000100:00080000:1.0:1782727427.573543:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727427.574773:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912490240 00000100:00100000:2.0:1782727427.574790:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912490240 00000100:00100000:2.0:1782727427.574968:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1782727427.574985:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef78191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912490240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727427.575112:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef78191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c805432-a345-4b8b-859c-fa0b2938956c+19:3447:x1869324912490240:12345-0@lo:400:kworker.0 Request processed in 133us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727427.575119:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1782727427.575240:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef7e63b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c805432-a345-4b8b-859c-fa0b2938956c:3447:1869324912490240:0@lo:400:kworker.0 00010000:00010000:3.0:1782727427.823484:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727428.079355:0:3447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cef77fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912490752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727428.079620:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727428.079925:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324912490752 00000100:00100000:0.0:1782727428.079959:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324912490752 00000100:00100000:0.0:1782727428.080024:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782727428.080035:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cef7e55bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912490752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727428.080077:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727428.080612:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cef7e55bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1869324912490752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 576us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727428.080624:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782727428.095603:0:3447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cef77fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3447:1869324912490752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782727428.847790:0:5939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727429.791073:0:12999:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_118d: @@@@@@ FAIL: No page in writeback, writeback=0 00010000:00010000:2.0:1782727429.871689:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782727430.643254:0:8023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1782727430.643287:0:8023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1782727430.643321:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1782727430.643349:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00010000:00010000:3.0:1782727430.896720:0:6954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 11969 lines, 11969 kept, 0 dropped, 0 bad.